-- Logs begin at Thu 2022-05-19 15:41:34 UTC, end at Thu 2022-05-19 16:52:06 UTC. -- May 19 16:17:38.964942 dv-cinder-842433-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 16:17:38.973771 dv-cinder-842433-1-smb devstack@keystone.service[80205]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 16:17:38.976466 dv-cinder-842433-1-smb devstack@keystone.service[80205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 16:17:38 2022] *** May 19 16:17:38.976663 dv-cinder-842433-1-smb devstack@keystone.service[80205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 16:17:38.976826 dv-cinder-842433-1-smb devstack@keystone.service[80205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 16:17:38.976989 dv-cinder-842433-1-smb devstack@keystone.service[80205]: nodename: dv-cinder-842433-1-smb May 19 16:17:38.977145 dv-cinder-842433-1-smb devstack@keystone.service[80205]: machine: x86_64 May 19 16:17:38.977311 dv-cinder-842433-1-smb devstack@keystone.service[80205]: clock source: unix May 19 16:17:38.977465 dv-cinder-842433-1-smb devstack@keystone.service[80205]: pcre jit disabled May 19 16:17:38.977612 dv-cinder-842433-1-smb devstack@keystone.service[80205]: detected number of CPU cores: 4 May 19 16:17:38.977765 dv-cinder-842433-1-smb devstack@keystone.service[80205]: current working directory: / May 19 16:17:38.977917 dv-cinder-842433-1-smb devstack@keystone.service[80205]: detected binary path: /usr/bin/uwsgi-core May 19 16:17:38.978077 dv-cinder-842433-1-smb devstack@keystone.service[80205]: your processes number limit is 47680 May 19 16:17:38.978249 dv-cinder-842433-1-smb devstack@keystone.service[80205]: your memory page size is 4096 bytes May 19 16:17:38.978405 dv-cinder-842433-1-smb devstack@keystone.service[80205]: detected max file descriptor number: 2048 May 19 16:17:38.978569 dv-cinder-842433-1-smb devstack@keystone.service[80205]: lock engine: pthread robust mutexes May 19 16:17:38.978879 dv-cinder-842433-1-smb devstack@keystone.service[80205]: thunder lock: enabled May 19 16:17:38.979182 dv-cinder-842433-1-smb devstack@keystone.service[80205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 16:17:38.979287 dv-cinder-842433-1-smb devstack@keystone.service[80205]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 16:17:39.026759 dv-cinder-842433-1-smb devstack@keystone.service[80205]: Python main interpreter initialized at 0x56177a9ec9c0 May 19 16:17:39.026759 dv-cinder-842433-1-smb devstack@keystone.service[80205]: python threads support enabled May 19 16:17:39.026759 dv-cinder-842433-1-smb devstack@keystone.service[80205]: your server socket listen backlog is limited to 100 connections May 19 16:17:39.026759 dv-cinder-842433-1-smb devstack@keystone.service[80205]: your mercy for graceful operations on workers is 90 seconds May 19 16:17:39.027150 dv-cinder-842433-1-smb devstack@keystone.service[80205]: mapped 403077 bytes (393 KB) for 2 cores May 19 16:17:39.027227 dv-cinder-842433-1-smb devstack@keystone.service[80205]: *** Operational MODE: preforking *** May 19 16:17:39.027462 dv-cinder-842433-1-smb devstack@keystone.service[80205]: *** uWSGI is running in multiple interpreter mode *** May 19 16:17:39.027462 dv-cinder-842433-1-smb devstack@keystone.service[80205]: spawned uWSGI master process (pid: 80205) May 19 16:17:39.027689 dv-cinder-842433-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 16:17:39.029117 dv-cinder-842433-1-smb devstack@keystone.service[80205]: spawned uWSGI worker 1 (pid: 80219, cores: 1) May 19 16:17:39.029117 dv-cinder-842433-1-smb devstack@keystone.service[80205]: spawned uWSGI worker 2 (pid: 80220, cores: 1) May 19 16:17:39.029117 dv-cinder-842433-1-smb devstack@keystone.service[80205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 16:17:44.786007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:17:44.786007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: from cryptography.utils import int_from_bytes May 19 16:17:44.786810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:17:44.786810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: from cryptography.utils import int_from_bytes May 19 16:17:44.787262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:17:44.787262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: from cryptography.utils import int_from_bytes May 19 16:17:44.787387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:17:44.787387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: from cryptography.utils import int_from_bytes May 19 16:17:44.837215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 16:17:44.837408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 16:17:44.837496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 16:17:44.837585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] command line args: [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 16:17:44.837670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 16:17:44.837851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 16:17:44.837937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] command line args: [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 16:17:44.838016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ================================================================================ {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 16:17:44.838138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 16:17:44.838277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] admin_token = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.838363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ================================================================================ {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 16:17:44.838528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] config_dir = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.838612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] admin_token = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.838719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.838805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] config_dir = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.838908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] config_source = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.838994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] debug = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] config_source = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] debug = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.839935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_config_append = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.840935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_config_append = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_dir = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_dir = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_file = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_file = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.841943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.842900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.843982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.844877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] publish_errors = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] publish_errors = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.845969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.846879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] standard_threads = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] standard_threads = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.847992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] use_journal = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] use_journal = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] use_json = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] use_json = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] use_stderr = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] use_stderr = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] use_syslog = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] use_syslog = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.848937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.849051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:17:44.849172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.849294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.849410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.850960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.851891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.852917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.853957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.854910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.855879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.856893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.857933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.858991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.859966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.860917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.861946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.862894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.863976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.864905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.865020 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.865169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.865831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.865949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.866979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.867993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.868897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.869969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.870964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.871936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.872979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.873986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.874927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.external = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.external = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.875953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.password = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] auth.token = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.password = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] auth.token = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.876907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.877985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.878925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.879893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.880956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.881926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.882934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.883904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884755 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.884995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.885939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.886980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.887943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.888885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.889951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.890953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891565 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.891968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.892988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.893996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.894939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.895888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.896987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897813 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.897929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.898997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.899897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.900970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.901914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.902964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.903920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.904722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.905986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.906912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] role.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] role.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.907881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] role.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] role.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.908958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.909901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.910954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.911934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.912563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.912662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.912774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.912876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.912974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.913987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914688 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.914981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.915938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.916940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.917950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.918924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.connection = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.919965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.connection = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.920929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.921880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.922977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.923969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.924042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 16:17:44.924114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.924186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.924415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:17:44.924588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 16:17:44.957069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.957276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.957276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.957490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.957490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.957660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.966615 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.966766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.997037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.997259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.997346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:44.997421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.051347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.051519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.103775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.104008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.104221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.104462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.171348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.171563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.171667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.171823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.171934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.172715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.197948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.198078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.198162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.198293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.198375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.210508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.210643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.225908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.226962 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.227036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.227108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.227210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.227292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.227365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80220) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.227438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80219) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 16:17:45.244490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.244699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 16:17:45.244920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.245039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.245122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 16:17:45.245251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 16:17:45.245463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.245555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.245666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 16:17:45.245748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.245937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.246019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.246200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.246289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.246458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.246714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.257386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.257661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.257891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.257988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.258175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.258266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.258451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.258734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.266376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.266937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.269699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.269984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.270264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.270375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.270546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.270637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.270831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.270923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.271182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.271275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.272928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.273116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.273206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.273419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.273695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.301259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.303256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.303671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.308476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.310173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.310452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.310891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.311180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.312176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.315896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.316182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.316469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.318978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.319266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.323990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.324114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.324281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.324367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.324572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.324858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.325138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.325419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.325693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.325963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.328955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.329283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.329566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.329850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.330190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.330468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.330745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.331014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.345404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.345685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.350782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.352981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.353272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.354445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.354740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.357838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.359734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.361498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.361796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.363321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.366813 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.367182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.367488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.367803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.368111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.368449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.368785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.370427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.374187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.374491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.374781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.375070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.375432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.375742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.387841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.388215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.388490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.388759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.394817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.395196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.395468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.395773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.397289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.399016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.399303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.402433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.402713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.402998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.403283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.403561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.404305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.406289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.406565 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.409684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.409966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.410260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.410549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.410829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.417857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.418138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.418424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.418707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.419002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.419282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.419574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.424867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.425151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.425437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.425734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.426017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.426298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.426585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.437825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.441118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.444519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.444931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.446124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.447813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.448103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.448244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.448394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.451573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.453197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.454843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.455132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.455420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.455873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.457510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.461313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.461598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.461882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.462174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.463418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.465088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.468363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.468659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.468947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.469228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.471451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.471762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.472055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.479149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.479470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.479784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.480529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80220) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.480817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.481103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.481384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.481662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.481953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.482239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.482514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.482798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.483068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.483349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.483610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.483906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.484184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80220) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.487738 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80219) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 16:17:45.488032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.488319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.488599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.488881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.489160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.489450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.489732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.490012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.490315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.490593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.490868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.491143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.491412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80219) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 16:17:45.523712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56177a9ec9c0 pid: 80220 (default app) May 19 16:17:45.527174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d498d33-1bd9-4f53-8405-66be7eb72c61 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:45.527461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d498d33-1bd9-4f53-8405-66be7eb72c61 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:45.527767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d498d33-1bd9-4f53-8405-66be7eb72c61 None None] PATH_INFO: `/v3` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:45.531175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56177a9ec9c0 pid: 80219 (default app) May 19 16:17:45.532259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu May 19 16:17:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:17:53.548023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:53.548599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:53.548599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:53.553398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:17:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:17:53.559507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:53.560021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:53.560204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:53.628679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: INFO dbcounter [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] Registered counter for database keystone May 19 16:17:53.651019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG oslo_db.sqlalchemy.engines [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:17:53.660726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writer thread running {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:17:53.905925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG passlib.handlers.bcrypt [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80220) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 16:17:53.906358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG passlib.handlers.bcrypt [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80220) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 16:17:53.964929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:17:53.966547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:17:54.093719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:17:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 536 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 16:17:54.281854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:54.352042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: INFO dbcounter [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] Registered counter for database keystone May 19 16:17:54.371852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG oslo_db.sqlalchemy.engines [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:17:54.378177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writer thread running {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:17:54.499640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217458f0-9bbb-4072-b3f4-b50a947f5ff9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:17:54.504144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:17:54.504819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:54.505108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:54.505391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:54.514329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:17:54.566595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 16:17:54.567216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232e02a-beb8-4486-8fc8-47861d6c93f1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:17:54.577781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu May 19 16:17:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:17:54.584388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:54.599782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48f89-df2f-40c8-969b-3c7fb5cd180b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:17:54.604207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:17:54.605335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:54.605620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:54.605898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] PATH_INFO: `/v3/projects/728349d622174859ba2f65ffafdfe844` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:54.607421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] RBAC: Authorizing `identity:get_project(project_id=728349d622174859ba2f65ffafdfe844)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:17:54.772018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 16:17:54.772360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c32a87-696b-4812-8dd2-75860fc10b7f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:17:54.777033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu May 19 16:17:54 2022] GET /identity/v3/projects/728349d622174859ba2f65ffafdfe844 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:17:56.978911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30337-fae7-4b66-b772-4a535bb86459 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:56.979426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30337-fae7-4b66-b772-4a535bb86459 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:56.979520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30337-fae7-4b66-b772-4a535bb86459 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:56.983576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:17:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:17:56.988999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:56.989377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:56.989557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:57.008738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:17:57.010241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:17:57.018007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:17:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 16:17:57.040756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a30337-fae7-4b66-b772-4a535bb86459 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:57.053240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a30337-fae7-4b66-b772-4a535bb86459 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:17:57.057397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067005bb-60e4-47af-a4f1-9d91c4f23bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:17:57.058026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067005bb-60e4-47af-a4f1-9d91c4f23bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:57.058311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067005bb-60e4-47af-a4f1-9d91c4f23bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:57.058589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067005bb-60e4-47af-a4f1-9d91c4f23bcc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:57.066167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067005bb-60e4-47af-a4f1-9d91c4f23bcc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:17:57.068022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067005bb-60e4-47af-a4f1-9d91c4f23bcc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:17:57.076947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu May 19 16:17:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 16:17:57.082541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:57.091550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648a9bc-4957-47c6-9b16-842cdd2b6e33 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:17:57.095921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d923a2-4124-4f34-b36d-ae7387e9fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:17:57.096786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d923a2-4124-4f34-b36d-ae7387e9fb90 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:57.097070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d923a2-4124-4f34-b36d-ae7387e9fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:57.097345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d923a2-4124-4f34-b36d-ae7387e9fb90 admin admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:57.098729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d923a2-4124-4f34-b36d-ae7387e9fb90 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:17:57.101156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d923a2-4124-4f34-b36d-ae7387e9fb90 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:17:57.102730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu May 19 16:17:57 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:17:59.421829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe0ffa-9a9b-4ce8-8571-d14f049ac00c None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:59.422381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe0ffa-9a9b-4ce8-8571-d14f049ac00c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:59.422381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe0ffa-9a9b-4ce8-8571-d14f049ac00c None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:59.423756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:17:59.429599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:59.430054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:59.430158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:59.446888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:17:59.448482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:17:59.449176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f1b1-e867-40ca-9c9d-63d41024d130 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:59.449470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f1b1-e867-40ca-9c9d-63d41024d130 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:59.449754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f1b1-e867-40ca-9c9d-63d41024d130 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:59.452211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:17:59.457869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:59.458161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:59.458954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:59.498677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG passlib.handlers.bcrypt [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80219) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 16:17:59.499111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG passlib.handlers.bcrypt [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80219) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 16:17:59.530621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:17:59.546382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:17:59.548050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:17:59.552620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:59.576007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:17:59.649887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:17:59.673914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:59.675304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeb50f-d9c2-4c73-b099-630e716a3651 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:17:59.713029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:17:59.713699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:59.713981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:59.714258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:59.788245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:17:59.789755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:17:59.813711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:17:59.885680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880907e2-4462-45b9-a879-b4bd0b612b31 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:17:59.888061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:17:59.890280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:17:59.895612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:17:59.925376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:17:59.926353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:17:59.926636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:17:59.926911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:17:59.944618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:17:59.960636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:17:59.961671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:17:59.962689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:17:59.967747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:00.002992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890d56f-6662-4379-b4ca-e5ba65266e24 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:00.026742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:00.038804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:00.039646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:00.039938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:00.040221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:00.050295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:00.051847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:00.069291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4ab49-4ba0-4a67-929c-8a9a4cb3f5dc None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:18:00.073229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:00.074071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:00.075087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:18:00.075087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:18:00.075087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:18:00.075087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:00.075087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:00.080466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:00.105791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:00.106460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:00.106744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:00.107022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:00.107818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:00.108128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:00.109586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:00.122235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:00.127838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:00.156371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:00.182781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea946-f2ce-4a09-808d-49e1377d3b21 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:00.217608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:00.218278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:00.218563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:00.218848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:00.219578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:00.219919 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:00.221358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:00.229479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f77204-f1c2-4ede-8bf2-b65dade77fba None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:00.238667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:00.266168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:00.267081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:00.267366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:00.267670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:00.269385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:00.270950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:00.272740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:00 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:00.278562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:00.316728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:00.391353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4f9b-ab8a-4954-a5b4-59e8784a8991 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:00.427868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ac8ae-da31-4ca3-8af4-804f0fbb440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:00.428674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac8ae-da31-4ca3-8af4-804f0fbb440e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:00.428956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac8ae-da31-4ca3-8af4-804f0fbb440e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:00.429233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac8ae-da31-4ca3-8af4-804f0fbb440e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:00.430429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ac8ae-da31-4ca3-8af4-804f0fbb440e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:00.431945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ac8ae-da31-4ca3-8af4-804f0fbb440e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:00.433811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:00.439409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:00.545635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:00.554489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb4192-13ec-4a44-97c7-9057cbe07909 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:00.589323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:00.589998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:00.590287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:00.590569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:00.591421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.domain.id=default, user.id=e0f89e69e35448a6b9abde79d014f879) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:00.591767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:00.593253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f4a0-9be0-4782-9ea2-ed49964f03bf None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:00.602742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Thu May 19 16:18:00 2022] GET /identity/v3/role_assignments?user.id=e0f89e69e35448a6b9abde79d014f879&scope.domain.id=default&role.id=627731b88fe44de39e8e182a119e4c00 => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:02.994762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29f4f-54b5-4d64-a332-a73eec6744d9 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:02.995837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29f4f-54b5-4d64-a332-a73eec6744d9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:02.996336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29f4f-54b5-4d64-a332-a73eec6744d9 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:02.998375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:03.007376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683b7d-e45f-4162-98c4-d0242dfaa8d6 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.008387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683b7d-e45f-4162-98c4-d0242dfaa8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.008931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683b7d-e45f-4162-98c4-d0242dfaa8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.014798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa93d5f-7738-473c-b523-3067fc69dc23 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.015435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa93d5f-7738-473c-b523-3067fc69dc23 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.015977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa93d5f-7738-473c-b523-3067fc69dc23 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.017626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:03.030621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.031252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.031755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.057122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:03.062396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e5683b7d-e45f-4162-98c4-d0242dfaa8d6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:03.063796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e5683b7d-e45f-4162-98c4-d0242dfaa8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:03.064319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:03.174426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 13/24] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:03.213885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:03.232379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:03.233654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a23d-809a-4515-a68e-b948a6ebbd60 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.233938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a23d-809a-4515-a68e-b948a6ebbd60 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.234387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a23d-809a-4515-a68e-b948a6ebbd60 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.236187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:03.241832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.242405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.242836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.260525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:03.261953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:03.292727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:03.337909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:03.339193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:03.388006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:03.470880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1892da-71e1-49eb-85c4-0d94ba4cab94 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:03.496800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb16406-ebd8-4e3c-b243-e28645c848a9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:03.509325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:03.510351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.510963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.511402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.532256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:03.534089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:18:03.554610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:03.555465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:03.556332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:18:03.556332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:18:03.556332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:18:03.556332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:03.558374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 15/28] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:03.559323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:03.576485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:03.577189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.577478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.577757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.578539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:03.580270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:03.651969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:03.709017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9970dca-05fa-4b8e-8838-421190c4c371 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:03.776695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087960-19e0-4199-8613-1a90d6866f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:03.777614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087960-19e0-4199-8613-1a90d6866f47 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:03.778047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087960-19e0-4199-8613-1a90d6866f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:03.778469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087960-19e0-4199-8613-1a90d6866f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:03.779373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087960-19e0-4199-8613-1a90d6866f47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:03.781343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087960-19e0-4199-8613-1a90d6866f47 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:03.789837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 14/29] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 19 16:18:03 2022] POST /identity/v3/roles => generated 219 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:18:03.791124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:03.944613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:03.967585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0d2fe-3833-40bf-83d7-a9cc996092ad None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.001856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 16/30] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 19 16:18:03 2022] POST /identity/v3/roles => generated 225 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:04.009209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028b54-eb7c-4882-a673-ffa2ab5ce0d1 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.010160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028b54-eb7c-4882-a673-ffa2ab5ce0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.010586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028b54-eb7c-4882-a673-ffa2ab5ce0d1 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.012258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 17/31] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:04.021341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.021644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.021933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.022592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.023278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.023561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.023864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.024735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:04.025143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:04.026815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:04.043055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 15/32] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:04.049124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.058837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:04.060477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:04.212857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:04.237251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892352e-6ee1-4726-b48d-cbd12ebcb95a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.247409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.304288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.304899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.305192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.305479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.306537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:04.308282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:04.326850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:04.357372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 16/34] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:18:04 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:18:04.392701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41417-a365-4f1b-a894-0f2b5d94f573 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.438799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af0aa-c554-4241-b0e2-96657f5b88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.439765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af0aa-c554-4241-b0e2-96657f5b88bc None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.440062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af0aa-c554-4241-b0e2-96657f5b88bc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.440349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af0aa-c554-4241-b0e2-96657f5b88bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.454510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207af0aa-c554-4241-b0e2-96657f5b88bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-207af0aa-c554-4241-b0e2-96657f5b88bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:04.462765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:04.463714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:04.464481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 19/35] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:04.470441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.477021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:04.594730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5eff5-590b-4aca-abdc-a2199c73bfe7 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.613574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994a52-182e-4df5-b8c0-403700f99386 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.613868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994a52-182e-4df5-b8c0-403700f99386 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.614153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994a52-182e-4df5-b8c0-403700f99386 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.616311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 20/36] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:04.624222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2095e9-26b7-4260-bd90-28b64114dd29 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.624518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2095e9-26b7-4260-bd90-28b64114dd29 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.624806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2095e9-26b7-4260-bd90-28b64114dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.637503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.638190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.638474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.638747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.639515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:04.639858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:04.641276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:04.649654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5e2095e9-26b7-4260-bd90-28b64114dd29 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:04.650892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5e2095e9-26b7-4260-bd90-28b64114dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:04.657140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 17/37] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:04.663559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.732681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 21/38] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:04.734034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617294d-b907-407c-961c-10f0c5f8c45a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.734331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617294d-b907-407c-961c-10f0c5f8c45a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.734689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617294d-b907-407c-961c-10f0c5f8c45a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.736105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 22/39] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:04.741362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.741652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.741939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.744892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:04.759687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:04.760921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:04.777233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c89d7-8530-40b8-b467-b9580662800c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.809281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:04.813385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808df78-3070-4593-b563-69986d138b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.814275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808df78-3070-4593-b563-69986d138b9b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.814555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808df78-3070-4593-b563-69986d138b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.814835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808df78-3070-4593-b563-69986d138b9b None admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.816098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808df78-3070-4593-b563-69986d138b9b None admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:04.817626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808df78-3070-4593-b563-69986d138b9b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:04.819285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 18/40] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:04 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:04.820097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808df78-3070-4593-b563-69986d138b9b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.831765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 23/41] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:04.832634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.938341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808df78-3070-4593-b563-69986d138b9b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.939872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e930-cbba-4856-8a78-01718eb6f73a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:04.975120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.975462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:04.975954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.976295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:04.976406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.976577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.976663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:04.976858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:04.977787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:04.978064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:04.979399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:04.979536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:04.981080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 24/42] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:04.981209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 19/43] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:04.982185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.986598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:04.989493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:05.034539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:05.086838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46aadd-5c63-46e5-ae83-26ff21118d61 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:05.088357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c20be-8493-4a94-b640-17b19d3a2771 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:05.120749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:05.121423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:05.121714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:05.121997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:05.122751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:05.123084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2fc8e-2a3a-4a7b-8965-14ac548eee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:05.123999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2fc8e-2a3a-4a7b-8965-14ac548eee2c None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:05.124198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:05.124297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2fc8e-2a3a-4a7b-8965-14ac548eee2c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:05.124562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2fc8e-2a3a-4a7b-8965-14ac548eee2c None admin] PATH_INFO: `/v3/domains/default/users/e0f89e69e35448a6b9abde79d014f879/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:05.126598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2fc8e-2a3a-4a7b-8965-14ac548eee2c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e0f89e69e35448a6b9abde79d014f879, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:05.128174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2fc8e-2a3a-4a7b-8965-14ac548eee2c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:05.138950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 25/44] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 19 16:18:04 2022] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:05.139847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:05.143226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 20/45] 10.222.0.25 () {58 vars in 1361 bytes} [Thu May 19 16:18:04 2022] PUT /identity/v3/domains/default/users/e0f89e69e35448a6b9abde79d014f879/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:18:05.270460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c89fd-d790-403f-ad5e-ec9e1343757c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:05.283224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:05.316207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe53c-c60e-4bc2-a319-719ff3536f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:05.316916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe53c-c60e-4bc2-a319-719ff3536f35 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:05.317207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe53c-c60e-4bc2-a319-719ff3536f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:05.317494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe53c-c60e-4bc2-a319-719ff3536f35 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:05.318809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe53c-c60e-4bc2-a319-719ff3536f35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:05.320473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe53c-c60e-4bc2-a319-719ff3536f35 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:05.357739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 26/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:18:05 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:07.409365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6fbf-083f-4bf1-a77e-d517dd940638 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.409907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6fbf-083f-4bf1-a77e-d517dd940638 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.410010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6fbf-083f-4bf1-a77e-d517dd940638 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.412030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 21/47] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:07.418181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f808-58a3-4403-9c78-a1bfb753652d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.418708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f808-58a3-4403-9c78-a1bfb753652d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.418914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f808-58a3-4403-9c78-a1bfb753652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.437201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b209f808-58a3-4403-9c78-a1bfb753652d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:07.438427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b209f808-58a3-4403-9c78-a1bfb753652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:07.510698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 27/48] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:07.533602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6fbf-083f-4bf1-a77e-d517dd940638 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:07.597794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:07.611387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574dec-6207-48d3-b5fa-47e5cc8c8f11 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.611704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574dec-6207-48d3-b5fa-47e5cc8c8f11 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.611994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574dec-6207-48d3-b5fa-47e5cc8c8f11 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.613394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 28/49] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:07.619159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.619454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.619776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.636376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:07.637591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:07.640999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6fbf-083f-4bf1-a77e-d517dd940638 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:07.674998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:07.675742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.676038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.676320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.688625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:07.697596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:07.698498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:07.699604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 22/50] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:07.704534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:07.705817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 29/51] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:07.729372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:07.754072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:07.807666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69b8d-7e67-4cba-ab7c-81d5b471e144 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:07.829363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:07.834215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df363744-e2d3-40f2-9d16-ae03035d2683 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:07.841633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:07.842308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.842596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.842877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.843658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:07.843976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:07.845397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:07.855558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 23/52] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:07.861036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:07.872025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:07.872902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:07.873186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:07.873459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:07.874632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:07.876131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:07.877741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 30/53] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:07.883076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:07.964398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0952c-39e0-423d-84d8-dc2e15647dcf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:07.972986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:07.988217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a7254-c0f4-4bf4-b501-f172c86eda34 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:08.003126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:08.004391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:08.004690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:08.004974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:08.006194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:08.007711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:08.009360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 24/54] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:07 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:08.014666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:08.023790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:08.024453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:08.024735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:08.025012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:08.025719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:08.027169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:08.053901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 31/55] 10.222.0.25 () {60 vars in 1140 bytes} [Thu May 19 16:18:07 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:18:08.071728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:08.123826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03398d-b578-460a-b9b7-42ff657bee6c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:08.160158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e35ab2-ec04-4ecb-82d8-e1babc83ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:08.160972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e35ab2-ec04-4ecb-82d8-e1babc83ab48 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:08.161584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e35ab2-ec04-4ecb-82d8-e1babc83ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:08.161584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e35ab2-ec04-4ecb-82d8-e1babc83ab48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:08.162861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e35ab2-ec04-4ecb-82d8-e1babc83ab48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:08.164410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e35ab2-ec04-4ecb-82d8-e1babc83ab48 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:08.166077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 25/56] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:08.171953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:08.292856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db6369-2037-46ae-ab0c-84dd811a5b94 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:08.326908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:08.327575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:08.327895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:08.328186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:08.329031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.domain.id=default, user.id=e0f89e69e35448a6b9abde79d014f879) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:08.329349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:08.330802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ddabf-f86c-4596-9fed-b55adcf858eb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:08.337497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 32/57] 10.222.0.25 () {56 vars in 1322 bytes} [Thu May 19 16:18:08 2022] GET /identity/v3/role_assignments?user.id=e0f89e69e35448a6b9abde79d014f879&scope.domain.id=default&role.id=627731b88fe44de39e8e182a119e4c00 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:10.289705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8101b-85fb-46c1-8818-4c7e2d5f7a85 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:10.290240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8101b-85fb-46c1-8818-4c7e2d5f7a85 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:10.290240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8101b-85fb-46c1-8818-4c7e2d5f7a85 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:10.291610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 26/58] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:10.296752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:10.297136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:10.297314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:10.303775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:10.315188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:10.316399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:10.382668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 33/59] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:10.407099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8101b-85fb-46c1-8818-4c7e2d5f7a85 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:10.507163 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8101b-85fb-46c1-8818-4c7e2d5f7a85 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:10.525719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:10.541083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505272a7-a530-4d7b-a736-7f7a0b4ede61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:10.541811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505272a7-a530-4d7b-a736-7f7a0b4ede61 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:10.542092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505272a7-a530-4d7b-a736-7f7a0b4ede61 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:10.542367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505272a7-a530-4d7b-a736-7f7a0b4ede61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:10.543528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505272a7-a530-4d7b-a736-7f7a0b4ede61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:10.545025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505272a7-a530-4d7b-a736-7f7a0b4ede61 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:10.546619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 27/60] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:10.552753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:10.647735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4425bcd-4aa1-4d86-83f6-67434304966b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:10.681239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2713-88d3-4344-affd-d34cb9d1af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:10.681902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2713-88d3-4344-affd-d34cb9d1af4b None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:10.682185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2713-88d3-4344-affd-d34cb9d1af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:10.682462 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2713-88d3-4344-affd-d34cb9d1af4b None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:10.683177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec2713-88d3-4344-affd-d34cb9d1af4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:10.684665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec2713-88d3-4344-affd-d34cb9d1af4b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:10.693048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:10.709160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 34/61] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:10 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:18:14.121105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a877-c4ea-46aa-bdeb-598d0016f607 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.121969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a877-c4ea-46aa-bdeb-598d0016f607 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.122420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a877-c4ea-46aa-bdeb-598d0016f607 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.123994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 28/62] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:14.129495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837127-055a-4968-b8da-6232c301775e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.130869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837127-055a-4968-b8da-6232c301775e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.131296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837127-055a-4968-b8da-6232c301775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.142465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5de8f-7d69-495e-b815-2afdfb59673b None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.142973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5de8f-7d69-495e-b815-2afdfb59673b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.143395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5de8f-7d69-495e-b815-2afdfb59673b None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.145075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 29/63] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:14.151372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.151710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.170361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-04837127-055a-4968-b8da-6232c301775e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:14.171608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-04837127-055a-4968-b8da-6232c301775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:14.186743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:14.188665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:14.314025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 35/64] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:14.323195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 30/65] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 16:18:14.344541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837127-055a-4968-b8da-6232c301775e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:14.365692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:14.502720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837127-055a-4968-b8da-6232c301775e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:14.548017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:14.569155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0633ea-2f22-4acf-aaa6-204f40eec2da None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:14.573117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64836948-c3f9-4082-8454-d07796f991a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:14.573941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64836948-c3f9-4082-8454-d07796f991a9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.574222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64836948-c3f9-4082-8454-d07796f991a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.574501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64836948-c3f9-4082-8454-d07796f991a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.588652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:14.590499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64836948-c3f9-4082-8454-d07796f991a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-64836948-c3f9-4082-8454-d07796f991a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:14.602526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:14.603449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:14.604466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 36/66] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:14.605127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32d3ac-0bdc-4def-9733-c140d6732ada None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.605341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32d3ac-0bdc-4def-9733-c140d6732ada None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.605620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32d3ac-0bdc-4def-9733-c140d6732ada None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.606903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 37/67] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:14.612082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee194dcd-0f75-4bbf-9796-a90cc12fcecc None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.612364 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee194dcd-0f75-4bbf-9796-a90cc12fcecc None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.612643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee194dcd-0f75-4bbf-9796-a90cc12fcecc None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.612993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e2a50-31c9-46e8-83a6-8ab39b96eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:14.613801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2a50-31c9-46e8-83a6-8ab39b96eec2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.614616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2a50-31c9-46e8-83a6-8ab39b96eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.614763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 38/68] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:14.614911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2a50-31c9-46e8-83a6-8ab39b96eec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.615512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee194dcd-0f75-4bbf-9796-a90cc12fcecc None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:14.626964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e2a50-31c9-46e8-83a6-8ab39b96eec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-5f9e2a50-31c9-46e8-83a6-8ab39b96eec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:14.635512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:14.636427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:14.637183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 31/69] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:14.638333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298c69-fda2-4ff5-ac3e-fdee461cc2c0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.638333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298c69-fda2-4ff5-ac3e-fdee461cc2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.643162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298c69-fda2-4ff5-ac3e-fdee461cc2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.658740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c1298c69-fda2-4ff5-ac3e-fdee461cc2c0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:14.659992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c1298c69-fda2-4ff5-ac3e-fdee461cc2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:14.733289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 32/70] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:14.739894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232e468-933a-4827-8827-26f73d29c208 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.739894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232e468-933a-4827-8827-26f73d29c208 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.739894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232e468-933a-4827-8827-26f73d29c208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.744627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee194dcd-0f75-4bbf-9796-a90cc12fcecc None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:14.759086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9232e468-933a-4827-8827-26f73d29c208 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:14.760814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9232e468-933a-4827-8827-26f73d29c208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:14.780763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:14.781438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.781726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.782004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.782756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:14.783065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:14.784514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:14.793942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 39/71] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:14.795031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:14.841087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 33/72] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:14.841959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232e468-933a-4827-8827-26f73d29c208 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:14.849834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:14.883684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:14.913055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c1d1-49b1-465f-9d07-bd529be68ada None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:14.947790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:14.948466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.948754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.949042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.949795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:14.950107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:14.951046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232e468-933a-4827-8827-26f73d29c208 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:14.951517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:14.959822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 40/73] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:14.960654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:14.985760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:14.986572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:14.986851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:14.987127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:14.997825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:15.005934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:15.006856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:15.007642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 34/74] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:15.008314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.065189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146549-eaca-41bb-b494-cf3ace8b6876 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.067451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.100783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff235e-69c2-4a15-b1e0-bb7b39cc69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.101652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff235e-69c2-4a15-b1e0-bb7b39cc69da None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.101939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff235e-69c2-4a15-b1e0-bb7b39cc69da None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.102213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff235e-69c2-4a15-b1e0-bb7b39cc69da None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.108540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.112915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb901623-3664-43b9-95e8-df45cf470c6f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.125500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff235e-69c2-4a15-b1e0-bb7b39cc69da None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.128105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff235e-69c2-4a15-b1e0-bb7b39cc69da None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.130992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 41/75] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:14 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:15.133049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f99a4-23fa-4ff2-bcdc-107d7627f65c None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.133527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f99a4-23fa-4ff2-bcdc-107d7627f65c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.134003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f99a4-23fa-4ff2-bcdc-107d7627f65c None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.137445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 42/76] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:15.137445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f99a4-23fa-4ff2-bcdc-107d7627f65c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.152213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.153508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.154164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.154711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.165284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:15.172990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:15.173906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:15.174687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 35/77] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:15.175321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.257460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f99a4-23fa-4ff2-bcdc-107d7627f65c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.295630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3c15-b743-4bcc-95ac-7f9a5194f7f8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.296742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.297626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.297920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.298201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.299406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.300920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.302586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 43/78] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:15.303368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.330528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.331124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.331432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.331722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.332478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:15.332796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.333997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.334739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c4077-acda-4ff9-a6a5-de716fc62e59 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.343478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 36/79] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:15.344746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.345043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.345332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.372216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:15.374383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:15.399145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.405448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdd23-bc41-42b4-8b4d-4d5b1bb72727 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.440580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.441234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.441520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.441799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.462204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:15.463074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.509386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.510877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.540629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.591381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4db8-8541-4334-8a50-51fac79e36ab None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.624028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 44/81] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:15.625619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.629239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.630413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.630703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.630992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.631765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:15.632077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.633483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.641845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 38/82] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:15.643316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.658954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.733371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43d24c-c37d-4b8a-bbdf-f2ec9cfcf85f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.742547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb036dd-b3d3-4941-83b6-50808caa507c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.761467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.767207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.767888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.768174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.768452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.776723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.777596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.777879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.778158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.779689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.781182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.782815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:15.783703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.838153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.839666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.863835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:15.883966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c4a8-ac81-4ea8-99f6-5014fc8cd29e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:15.920231 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:15.921031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:15.921309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:15.921578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:15.922760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:15.924254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:15.925868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 40/84] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:15.926660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.944300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 45/85] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:15.944300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:15.970428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.034314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f9b8e-2379-47ee-ae6d-16bfe143957c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.045700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd9237-9fe5-458a-9f87-6d2bef518af3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.068490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.069343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.069627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.069903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.071090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.072593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.074315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 41/86] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:16.075076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.085013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.085898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.086549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.086834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.088120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.089597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.091235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 46/87] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:15 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:16.092002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.095985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.176518 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b778-df93-4608-8e82-5230ab1e7456 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.211777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.212426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.212707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.212981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.223267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.227534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed8a7-e849-4798-85af-7237d372288a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.263023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.263714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.263998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.264279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.264988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.266441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.281121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.282597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.285634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 47/88] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:16 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:16.286473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.301018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.415931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 42/89] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:16.418283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961cfcc-0753-45b8-bbb7-50527dc24a79 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.421818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.456191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.456987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.457276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.457552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.458837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.460347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.462171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 48/90] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:16.462865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.492807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.544421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4a25-7533-4821-a1f2-73c8d9ab25cd None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.564942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.594824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.595500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.595816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.596105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.596958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=3a4b9074f6ee42cea226d3c5b226e887) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:16.597342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.598083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab65b7-99d3-4a57-9de7-cbf06e61507f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.599321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.609292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 43/91] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/role_assignments?user.id=3a4b9074f6ee42cea226d3c5b226e887&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:16.610148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.644223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.644994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.645376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.645725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.727745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.729426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.745623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17b72b-07c0-4890-8397-7dd9d9b76835 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.758810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.789327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.790453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.791864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.792380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.793983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.795648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.804055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:16.805289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.847765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 49/93] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:16.852754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.862672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.922647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf7ce6-9f65-4585-8417-9774da6f1d6c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.958549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c62d7-6074-42e9-ab64-32bad2542972 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:16.962382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.963326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.963857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:16.964329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:16.965399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=e0f89e69e35448a6b9abde79d014f879) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:16.965928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:16.967761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:16.975575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 45/94] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/role_assignments?user.id=e0f89e69e35448a6b9abde79d014f879&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:16.976830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:16.985093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:16.998844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:16.999550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:16.999873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:17.000158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:17.001071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] RBAC: Adding query filter params (role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=3a4b9074f6ee42cea226d3c5b226e887) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:17.001620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:17.003568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:17.013650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 50/95] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/role_assignments?user.id=3a4b9074f6ee42cea226d3c5b226e887&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:17.148414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869479f0-3d25-4d6f-8008-55bbd99200d4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:17.168016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:17.212389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf640fa-c8fc-4f42-8f4c-63729a1910f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:17.213292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf640fa-c8fc-4f42-8f4c-63729a1910f8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:17.213576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf640fa-c8fc-4f42-8f4c-63729a1910f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:17.213854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf640fa-c8fc-4f42-8f4c-63729a1910f8 None admin] PATH_INFO: `/v3/projects/1079caea119c4fd1a107370aa337439c` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:17.215194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf640fa-c8fc-4f42-8f4c-63729a1910f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1079caea119c4fd1a107370aa337439c)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:17.216770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf640fa-c8fc-4f42-8f4c-63729a1910f8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:17.218690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:16 2022] GET /identity/v3/projects/1079caea119c4fd1a107370aa337439c => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:17.224901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:17.391227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a522-4904-4e44-8f3a-efdcd5ad683a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:17.437954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:17.438628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:17.439230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:17.439515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:17.440391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=1079caea119c4fd1a107370aa337439c, user.id=3a4b9074f6ee42cea226d3c5b226e887) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:17.440710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:17.442722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2314b-8e9b-4f6c-a716-408e08758bd3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:17.449257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 51/97] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:17 2022] GET /identity/v3/role_assignments?user.id=3a4b9074f6ee42cea226d3c5b226e887&scope.project.id=1079caea119c4fd1a107370aa337439c&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:19.463002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b572f2-b15e-4340-b579-d789449aedd1 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:19.463585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b572f2-b15e-4340-b579-d789449aedd1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:19.463708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b572f2-b15e-4340-b579-d789449aedd1 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:19.465323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 47/98] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:19.474285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:19.474836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:19.474836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:19.498663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:19.500040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:19.565008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:19.588679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 52/99] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:19.619291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b572f2-b15e-4340-b579-d789449aedd1 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:19.757580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b572f2-b15e-4340-b579-d789449aedd1 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:19.800677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0489b-49f3-4d7c-9f6c-0c659db4d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:19.802059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0489b-49f3-4d7c-9f6c-0c659db4d407 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:19.802346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0489b-49f3-4d7c-9f6c-0c659db4d407 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:19.802626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0489b-49f3-4d7c-9f6c-0c659db4d407 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:19.821887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0489b-49f3-4d7c-9f6c-0c659db4d407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a2a0489b-49f3-4d7c-9f6c-0c659db4d407 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:19.833059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:19.834125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:19.834916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:19.836098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 48/100] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:19.840345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:19.861795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc2d9-61b6-44b6-9749-b79892184ca4 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:19.862111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc2d9-61b6-44b6-9749-b79892184ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:19.862369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc2d9-61b6-44b6-9749-b79892184ca4 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:19.864751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 49/101] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:19.871289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b76af-ec53-4215-ac56-d61320edd43a None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:19.871654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b76af-ec53-4215-ac56-d61320edd43a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:19.871958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b76af-ec53-4215-ac56-d61320edd43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:19.908663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-dd0b76af-ec53-4215-ac56-d61320edd43a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:19.910131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dd0b76af-ec53-4215-ac56-d61320edd43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:20.006046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b01b7-b707-4a88-9918-da2f011dda5b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.015097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.047972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.049031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.049478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.049907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.050813 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:20.051272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:20.053377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbad39-7d09-4afd-bb5e-0c1581a16423 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:20.062936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 53/102] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:20.064851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c028-d79e-4f0c-b454-d12d571edcb9 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.065333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c028-d79e-4f0c-b454-d12d571edcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.065769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c028-d79e-4f0c-b454-d12d571edcb9 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.069402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 54/103] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:20.073835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165c028-d79e-4f0c-b454-d12d571edcb9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.104968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 50/104] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:20.106585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.107040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.107463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.125161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:20.126701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:20.155983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.201501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 51/105] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:20.202754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.211232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165c028-d79e-4f0c-b454-d12d571edcb9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.254235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffbd51-b7ac-4808-b25e-085a432fd905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.255428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffbd51-b7ac-4808-b25e-085a432fd905 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.255935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffbd51-b7ac-4808-b25e-085a432fd905 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.256404 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffbd51-b7ac-4808-b25e-085a432fd905 None admin] PATH_INFO: `/v3/users/9092fbcc222e4c29b1c8c14418190442` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.270946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffbd51-b7ac-4808-b25e-085a432fd905 None admin] RBAC: Authorizing `identity:get_user(user_id=9092fbcc222e4c29b1c8c14418190442)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:20.272759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffbd51-b7ac-4808-b25e-085a432fd905 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:20.275070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 55/106] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/users/9092fbcc222e4c29b1c8c14418190442 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:20.276598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2bef-a97d-4511-b38a-5f02224bd2cd None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.277095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2bef-a97d-4511-b38a-5f02224bd2cd None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.277580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2bef-a97d-4511-b38a-5f02224bd2cd None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.279066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 56/107] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:20.284091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2bef-a97d-4511-b38a-5f02224bd2cd None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.311717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.315311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d388d4-8e72-48b4-a849-b23a28805ba9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.358660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.359997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.360802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.361568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.363152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:20.365487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:20.367640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 52/108] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:20.369183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.409126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.420450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2bef-a97d-4511-b38a-5f02224bd2cd None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.463887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f1438-5539-476f-9b30-7ce0c4332df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.465055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1438-5539-476f-9b30-7ce0c4332df3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.465559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1438-5539-476f-9b30-7ce0c4332df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.466129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1438-5539-476f-9b30-7ce0c4332df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.477598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f1438-5539-476f-9b30-7ce0c4332df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-5d7f1438-5539-476f-9b30-7ce0c4332df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:20.486102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:20.486965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:20.487756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:20.495450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 57/109] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:20.497147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.497649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.498140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.498249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e708a1-6bdb-482d-ad0a-e093b3649717 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.517585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:20.519132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:20.537851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.538737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.539180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.539705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.581119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.590619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 58/110] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:20.596586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.624249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:20.626042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:20.700471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.714380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feebb23-7550-499e-bec3-4aa5a854c47f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.747335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 53/111] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:20.747335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.752315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eaa5a-6b6d-4a2d-92a1-3b286243f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.753076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaa5a-6b6d-4a2d-92a1-3b286243f60c None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.753365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaa5a-6b6d-4a2d-92a1-3b286243f60c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.753703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaa5a-6b6d-4a2d-92a1-3b286243f60c None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.754441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eaa5a-6b6d-4a2d-92a1-3b286243f60c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:20.756548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eaa5a-6b6d-4a2d-92a1-3b286243f60c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:20.782973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 59/112] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:18:20 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:20.784665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c00d-7fff-475c-9053-3c5428bb6d1f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.785203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c00d-7fff-475c-9053-3c5428bb6d1f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.785639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c00d-7fff-475c-9053-3c5428bb6d1f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.787237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 60/113] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:20.788110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c00d-7fff-475c-9053-3c5428bb6d1f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.828876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:20.871864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d501-9a93-4a68-a66e-0bb6ac6572a4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.927379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.928115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.928391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.928668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:20.929443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:20.929758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:20.931210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:20.940795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 54/114] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:20.941526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:20.952948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c00d-7fff-475c-9053-3c5428bb6d1f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:20.993391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdbf8a-7d38-41fe-a33a-b3c27c2e36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:20.994198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdbf8a-7d38-41fe-a33a-b3c27c2e36df None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:20.994485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdbf8a-7d38-41fe-a33a-b3c27c2e36df None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:20.994759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdbf8a-7d38-41fe-a33a-b3c27c2e36df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.008218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdbf8a-7d38-41fe-a33a-b3c27c2e36df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-4dfdbf8a-7d38-41fe-a33a-b3c27c2e36df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:21.015975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:21.016916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:21.017674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 61/115] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:21.019333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.019647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.019924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.025707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.040741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:21.041844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:21.064453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18480760-bea3-488f-b1ee-89cedd1f3dc7 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.093235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.100775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca314c6-5a71-4543-bdac-cea6d2c51861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.101858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca314c6-5a71-4543-bdac-cea6d2c51861 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.102388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca314c6-5a71-4543-bdac-cea6d2c51861 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.102500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca314c6-5a71-4543-bdac-cea6d2c51861 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.103700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca314c6-5a71-4543-bdac-cea6d2c51861 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:21.105213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca314c6-5a71-4543-bdac-cea6d2c51861 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:21.106929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 55/116] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:20 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:21.108297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38befbb-ac75-496d-86a4-741361efe0e0 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.108589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38befbb-ac75-496d-86a4-741361efe0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.108867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38befbb-ac75-496d-86a4-741361efe0e0 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.110238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 56/117] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:21.115481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38befbb-ac75-496d-86a4-741361efe0e0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.130750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 62/118] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:21.131899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.229538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38befbb-ac75-496d-86a4-741361efe0e0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.252409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112744-ea9d-4b01-9fff-87be8506a9c8 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.266187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.267076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.267365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.267665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.268927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:21.270454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:21.272370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 57/119] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:21.273360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.293851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.304763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.305074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.305368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.305653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.306417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:21.307200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:21.308649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59929d-f785-49eb-a720-b99210915ef3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:21.318115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 63/120] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:21.319387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.319711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.319993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.337456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:21.338668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:21.351284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.395481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadcfab-6f78-45e7-900d-9e3c0939dc15 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.421113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 64/121] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:21.422202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.445754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.446524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.446812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.447088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.447970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] RBAC: Adding query filter params (role.id=0bab154d01a142039b70426c79b3fc0a, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=9092fbcc222e4c29b1c8c14418190442) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:21.448280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:21.449772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:21.455936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 58/122] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/role_assignments?user.id=9092fbcc222e4c29b1c8c14418190442&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=0bab154d01a142039b70426c79b3fc0a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:21.456572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.565585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5ea73-2c2a-4899-a4d2-9a96c8f43037 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.593427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.608055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.608886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.609280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.609568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.610604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980c965-d11f-4685-ada4-c0a2a8827317 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.622993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:21.631731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:21.632667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:21.633442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:21.638090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 65/123] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:21.639097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.652358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.658226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.659983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.660662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.661557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.662935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:21.665445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:21.671446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 59/124] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:21.671446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.785217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e0b4-391b-4ded-bf00-70f8be0f9aa9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.785438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b5a4b-e367-4e69-b932-f1c8601835ed None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:21.825468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.826411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.826699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.826980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.828291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:21.829797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:21.830292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:21.831381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:21.831774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 66/125] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:21.832084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:21.832513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:21.833140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.847943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:21.859756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:21.860909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:21.861802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:21.864890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 60/126] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:21.865998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:21.913155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.948982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:21.976952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9e62-9584-4ebc-8a1b-d3d4211a4a3d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.013704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.014143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea958-7c57-4ef2-ba36-682257ca6701 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.014392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.014690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.014964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.015777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:22.016096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.017520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.027730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 67/127] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:22.028683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.065434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.067535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.068074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.069580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307/users/e0f89e69e35448a6b9abde79d014f879/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.071955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3ab599465546119d3df661adb91307, user_id=e0f89e69e35448a6b9abde79d014f879, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.074407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.091946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 61/128] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:21 2022] PUT /identity/v3/projects/2e3ab599465546119d3df661adb91307/users/e0f89e69e35448a6b9abde79d014f879/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:22.093617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.162429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb5fb3-bf5e-42df-8622-43cdc90bc4ee None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.183009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:22.213204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.214648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.215145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.215662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.217375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.219399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.221926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 68/129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:22 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:22.223134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.356955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5129d-8e35-4940-9d30-833b576d511f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.403335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.405118 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.405411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.405698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.406978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.408986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.410988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 69/130] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:22 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:22.412027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.420598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464404-f998-4336-a072-0ff3014e95c1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.453980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:22.459153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.459874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.460312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.460742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.461946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:22.462422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.468666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.477290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:22.490030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 62/131] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:22.490909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.552352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0adca1-1be8-42f8-b7a7-fa5c4c3d849c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.599151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.600238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.600533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.600816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307/users/3a4b9074f6ee42cea226d3c5b226e887/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.605149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3ab599465546119d3df661adb91307, user_id=3a4b9074f6ee42cea226d3c5b226e887, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.607840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.657146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 70/132] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:22 2022] PUT /identity/v3/projects/2e3ab599465546119d3df661adb91307/users/3a4b9074f6ee42cea226d3c5b226e887/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:22.657800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.675152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b429-5c7e-4ed6-aa96-a0ed7356c8a0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.724776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.725737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.726082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.726368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.730053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.731650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.734276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 63/133] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:22 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:22.740600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:22.812140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:22.894695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea3c5-d5c8-4cae-a377-74d9575234ac None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.940232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:22.941149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:22.941436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:22.941716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307/users/3a4b9074f6ee42cea226d3c5b226e887/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:22.945123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3ab599465546119d3df661adb91307, user_id=3a4b9074f6ee42cea226d3c5b226e887, role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:22.946663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:22.977094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8865d-36bb-4433-a6c2-652cd14960b9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:22.979353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 64/134] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:22 2022] PUT /identity/v3/projects/2e3ab599465546119d3df661adb91307/users/3a4b9074f6ee42cea226d3c5b226e887/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:18:22.998544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:23.022433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:23.023695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:23.024250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:23.024539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:23.026013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:23.027667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:23.029937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 71/135] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:22 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:23.036463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:23.168831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883755f-8ddf-4b7f-bf24-4c9ac1fe8d69 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:23.183101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:23.214388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20afeeb-4aab-4dd5-aa79-076f2f1afb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:23.215297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20afeeb-4aab-4dd5-aa79-076f2f1afb11 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:23.215585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20afeeb-4aab-4dd5-aa79-076f2f1afb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:23.215891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20afeeb-4aab-4dd5-aa79-076f2f1afb11 None admin] PATH_INFO: `/v3/projects/1079caea119c4fd1a107370aa337439c` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:23.217258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20afeeb-4aab-4dd5-aa79-076f2f1afb11 None admin] RBAC: Authorizing `identity:get_project(project_id=1079caea119c4fd1a107370aa337439c)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:23.218819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20afeeb-4aab-4dd5-aa79-076f2f1afb11 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:23.222046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 65/136] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:23 2022] GET /identity/v3/projects/1079caea119c4fd1a107370aa337439c => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:23.227654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:23.381779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6e29e-9ccc-432b-8d15-79d89ad91492 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:23.425710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e750bf-0ce2-459c-9f99-b6f39e20cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:23.426633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e750bf-0ce2-459c-9f99-b6f39e20cf1d None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:23.426922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e750bf-0ce2-459c-9f99-b6f39e20cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:23.427205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e750bf-0ce2-459c-9f99-b6f39e20cf1d None admin] PATH_INFO: `/v3/projects/1079caea119c4fd1a107370aa337439c/users/3a4b9074f6ee42cea226d3c5b226e887/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:23.429344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e750bf-0ce2-459c-9f99-b6f39e20cf1d None admin] RBAC: Authorizing `identity:create_grant(project_id=1079caea119c4fd1a107370aa337439c, user_id=3a4b9074f6ee42cea226d3c5b226e887, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:23.430829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e750bf-0ce2-459c-9f99-b6f39e20cf1d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:23.450152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 72/137] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:23 2022] PUT /identity/v3/projects/1079caea119c4fd1a107370aa337439c/users/3a4b9074f6ee42cea226d3c5b226e887/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:23.630562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2054f9-bb5c-4c41-9584-b41515b2c1d5 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:23.630926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2054f9-bb5c-4c41-9584-b41515b2c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:23.631126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2054f9-bb5c-4c41-9584-b41515b2c1d5 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:23.632763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 66/138] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:23.638653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:23.639174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:23.639246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:23.664001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:23.665241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:23.707346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:23.751225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 73/139] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:23.776263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2054f9-bb5c-4c41-9584-b41515b2c1d5 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:23.899164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2054f9-bb5c-4c41-9584-b41515b2c1d5 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:23.938650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f18f85-3c2a-40e4-bb9e-20797a5ec198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:23.939455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18f85-3c2a-40e4-bb9e-20797a5ec198 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:23.939775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18f85-3c2a-40e4-bb9e-20797a5ec198 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:23.940058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18f85-3c2a-40e4-bb9e-20797a5ec198 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:23.941308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18f85-3c2a-40e4-bb9e-20797a5ec198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:23.942884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18f85-3c2a-40e4-bb9e-20797a5ec198 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:23.944729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 67/140] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:23.950130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:24.065457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e6b8-f7b4-4508-b1be-9d01ac85c68b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:24.121331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804bfb1-14e3-448a-a32b-7f69166f9975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:24.122026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804bfb1-14e3-448a-a32b-7f69166f9975 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:24.122317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804bfb1-14e3-448a-a32b-7f69166f9975 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:24.122597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804bfb1-14e3-448a-a32b-7f69166f9975 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:24.123403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804bfb1-14e3-448a-a32b-7f69166f9975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:24.125042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804bfb1-14e3-448a-a32b-7f69166f9975 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:24.162876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 74/141] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:23 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:24.525885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141d35-a9bb-4851-aa98-582fc11ff91b None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:24.525885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141d35-a9bb-4851-aa98-582fc11ff91b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:24.525885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141d35-a9bb-4851-aa98-582fc11ff91b None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:24.525885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 68/142] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:24.532906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:24.533541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:24.534023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:24.552629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:24.554193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:24.575298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:24.646516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 75/143] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:24.684447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe141d35-a9bb-4851-aa98-582fc11ff91b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:24.751273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:24.824587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe141d35-a9bb-4851-aa98-582fc11ff91b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:24.863567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810e251-94cd-4d1a-b15d-ad9761ddee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:24.865120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810e251-94cd-4d1a-b15d-ad9761ddee62 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:24.865410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810e251-94cd-4d1a-b15d-ad9761ddee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:24.865691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810e251-94cd-4d1a-b15d-ad9761ddee62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:24.877363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810e251-94cd-4d1a-b15d-ad9761ddee62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9810e251-94cd-4d1a-b15d-ad9761ddee62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:24.886408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:24.887368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:24.888170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 69/144] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:24.895546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:24.925958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0957b6-3406-4537-aaba-2ae5546b198c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:24.926807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0957b6-3406-4537-aaba-2ae5546b198c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:24.927071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0957b6-3406-4537-aaba-2ae5546b198c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:24.929483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 70/145] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:24.935757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:24.936054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:24.936339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:24.957982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:24.959202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:25.052125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 71/146] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:25.072811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64fc16-2170-4a23-a736-f0491f746406 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.078325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.123799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:25.135647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.136847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.137337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.137828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.138778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:25.139389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:25.141128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:25.158165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 76/147] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:25.181343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.208359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1f20-e3da-4c3e-900a-26582c79bff4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.216602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:25.253850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.254870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.255260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.255654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.270007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:25.280039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:25.280970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:25.281734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:25.282312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 72/148] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:25.289342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.359472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e9fb-f176-4933-a24f-26746d9b47b9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.409859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:25.418068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511918-553c-44e9-bfd3-2cd6d2f92ce7 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.424170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.425359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.425856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.426342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] PATH_INFO: `/v3/users/9092fbcc222e4c29b1c8c14418190442` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.429543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=9092fbcc222e4c29b1c8c14418190442)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:25.431379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:25.433318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 77/149] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:25 2022] GET /identity/v3/users/9092fbcc222e4c29b1c8c14418190442 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:25.447439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.460892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.466715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.466715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.466715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.466715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:25.466715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:25.466715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:25.477292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 73/150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:25.484338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.608696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92641-06c6-422c-946e-dfe256cab954 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.610714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:25.648900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.649899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.650187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.650465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] PATH_INFO: `/v3/users/e0f89e69e35448a6b9abde79d014f879` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.651741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f89e69e35448a6b9abde79d014f879)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:25.653559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:25.654810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174839-2a27-4101-b9ed-998bfcd3d9b1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.655740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 74/151] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:25 2022] GET /identity/v3/users/e0f89e69e35448a6b9abde79d014f879 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:25.662784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.693796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:25.752396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.753300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.753586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.753862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.755744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:25.757258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:25.759101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 78/152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:25 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:25.768660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:25.787385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac771e-5f95-4d83-93b6-aec7dc88e0e3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:25.827759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:25.828535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:25.828913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:25.829206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:25.920910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:25.922527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:25.962395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:26.064646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790de4ac-72fe-40a8-a7f6-9a8286d0a3b1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:26.065478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 75/153] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:18:26.071701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:26.152510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:26.153346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.153632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.153910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307/users/9092fbcc222e4c29b1c8c14418190442/roles/0bab154d01a142039b70426c79b3fc0a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.156361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3ab599465546119d3df661adb91307, user_id=9092fbcc222e4c29b1c8c14418190442, role_id=0bab154d01a142039b70426c79b3fc0a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:26.157849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:26.190325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 79/154] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:25 2022] PUT /identity/v3/projects/2e3ab599465546119d3df661adb91307/users/9092fbcc222e4c29b1c8c14418190442/roles/0bab154d01a142039b70426c79b3fc0a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:26.201270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114831b9-1fa3-41d5-9146-e0fac06eb2cd None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:26.228817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:26.241513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be74da-6c22-4c01-b7b1-69f8684fa97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:26.242391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be74da-6c22-4c01-b7b1-69f8684fa97b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.242677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be74da-6c22-4c01-b7b1-69f8684fa97b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.242954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be74da-6c22-4c01-b7b1-69f8684fa97b None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.244232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be74da-6c22-4c01-b7b1-69f8684fa97b None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:26.245743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be74da-6c22-4c01-b7b1-69f8684fa97b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:26.249045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 76/155] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:26 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:26.253828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:26.272035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a172ab-246f-4d7d-a581-68dfa4559c7d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.272331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a172ab-246f-4d7d-a581-68dfa4559c7d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.272593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a172ab-246f-4d7d-a581-68dfa4559c7d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.273978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 77/156] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:26.276136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:26.280028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.280469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.280590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.305924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:26.307152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:26.456087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:26.480017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c54c7-36e5-4b52-b39e-f2757ca36bc3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:26.480955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:26.541453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:26.542222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.542506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.542784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.543650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=e0f89e69e35448a6b9abde79d014f879) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:26.543968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:26.545432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:26.558244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 80/158] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:26 2022] GET /identity/v3/role_assignments?user.id=e0f89e69e35448a6b9abde79d014f879&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:26.607233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323629a-1b50-45f9-9a0b-4187c5567276 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:26.648280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:26.650997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:26.651983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.652598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.653030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.667197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:26.675561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:26.677312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:26.678323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:26.683451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 79/159] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:26.687140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:26.786357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:26.818471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c86bce-0f59-4901-9193-f4b00caaff83 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:26.860586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:26.861579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:26.862014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:26.862446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:26.863387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:26.864629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:26.866277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:26.879971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 81/160] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:26.886207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:27.017989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f5c9-1b4f-434e-9428-c2165a9d0f93 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:27.061354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3fc7a-6bab-47b5-abd8-5360eb5c7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:27.062162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3fc7a-6bab-47b5-abd8-5360eb5c7d3f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.062444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3fc7a-6bab-47b5-abd8-5360eb5c7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.062722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3fc7a-6bab-47b5-abd8-5360eb5c7d3f None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.063988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3fc7a-6bab-47b5-abd8-5360eb5c7d3f None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:27.065664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3fc7a-6bab-47b5-abd8-5360eb5c7d3f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:27.067789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 80/161] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:26 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:27.073470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:27.085272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd186-755c-4f3d-a55e-79edd8a2e5c9 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.085567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd186-755c-4f3d-a55e-79edd8a2e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.085852 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd186-755c-4f3d-a55e-79edd8a2e5c9 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.087241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 81/162] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:27.093466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.093756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.094026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.126533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:27.127758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:27.219901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:27.255088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 82/163] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:27.258920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c971-a663-4d90-88f2-0991f05d39b7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:27.295064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:27.300188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:27.300188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.300188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.300188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.310844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:27.432049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:27.435264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:27.511714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea243-ca7f-4078-9f38-bc3ad6593f29 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:27.603676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 82/164] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:27.608981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:27.609819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.610103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.610378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.624751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:27.625162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:27.633999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:27.634901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:27.635703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 83/165] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:27.642993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:27.731149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:27.752727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:27.880886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5494f-7088-46ac-8dc9-5492420ea554 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:27.886646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7155-b040-4b94-8afc-db78aaae0a96 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:27.957452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:27.958367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.958652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.958930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.961415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:27.962115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:27.962398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:27.962679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:27.963479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:27.963821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:27.965117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:27.966624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:27.969614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:27.975664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 83/166] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:27 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:27.975884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:27.989777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 84/167] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:27.997579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:28.196861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec9c71-b84d-4d93-931d-b43ef526c75a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:28.217144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:28.269087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff28b3-1efd-42c9-8fc7-6825a6925acb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:28.273214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:28.299424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:28.300821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:28.301910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:28.302400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:28.303433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=3a4b9074f6ee42cea226d3c5b226e887) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:28.303960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:28.306543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:28.317463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 84/168] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:27 2022] GET /identity/v3/role_assignments?user.id=3a4b9074f6ee42cea226d3c5b226e887&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:28.340464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7ab34-c222-45ac-a436-fe6276d25307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:28.341713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ab34-c222-45ac-a436-fe6276d25307 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:28.342187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ab34-c222-45ac-a436-fe6276d25307 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:28.342698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ab34-c222-45ac-a436-fe6276d25307 None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:28.348973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7ab34-c222-45ac-a436-fe6276d25307 None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:28.350702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7ab34-c222-45ac-a436-fe6276d25307 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:28.352913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 85/169] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:27 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:28.358603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:28.506718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2bb45-3706-4732-820b-9b9d42f0ef39 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:28.558850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:28.559547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:28.559897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:28.560138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:28.616939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:28.631032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b040-2163-4815-98fd-e688886921de None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:28.631692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b040-2163-4815-98fd-e688886921de None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:28.632165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b040-2163-4815-98fd-e688886921de None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:28.634081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 86/170] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:28.639459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:28.640102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:28.640625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:28.652384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:28.653894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:28.676782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:28.678422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:28.812599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 87/171] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:28.815221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 85/172] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:28.821589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:28.853808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:28.992066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:29.012904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:29.017233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b0f59-6400-4c70-afba-de2219392fe0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:29.039788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c075d8e-4579-4600-ba92-b518d9b79a08 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:29.085430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:29.086222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.086501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.086774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.088355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:29.089863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:29.091837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 88/173] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:28 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:29.098255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:29.104436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:29.105274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.105564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.105867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.121486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:29.135909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:29.136869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:29.137709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 86/174] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:29.143718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:29.261691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf6cd3-11ea-46af-8ba3-8dca029ba5e2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:29.266664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35582ff-9511-4a20-b8c2-38538678c6df None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:29.298529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:29.299212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.299498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.299810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.300580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:29.300894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:29.302853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:29.312501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:29.313107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:29.319181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:29.389158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:29.389754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.390042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.390328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.391186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] RBAC: Adding query filter params (role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=3a4b9074f6ee42cea226d3c5b226e887) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:29.391500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:29.393042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:29.413732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 89/176] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:29 2022] GET /identity/v3/role_assignments?user.id=3a4b9074f6ee42cea226d3c5b226e887&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:29.430784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47c6d1-3b8c-41b8-b3d8-1954d9c59a70 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:29.468646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd1c2-18b6-4a0b-92a4-78f366ebf970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:29.469562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd1c2-18b6-4a0b-92a4-78f366ebf970 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.469848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd1c2-18b6-4a0b-92a4-78f366ebf970 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.470136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd1c2-18b6-4a0b-92a4-78f366ebf970 None admin] PATH_INFO: `/v3/users/3a4b9074f6ee42cea226d3c5b226e887` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.471479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fd1c2-18b6-4a0b-92a4-78f366ebf970 None admin] RBAC: Authorizing `identity:get_user(user_id=3a4b9074f6ee42cea226d3c5b226e887)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:29.473527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fd1c2-18b6-4a0b-92a4-78f366ebf970 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:29.475216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 88/177] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:29 2022] GET /identity/v3/users/3a4b9074f6ee42cea226d3c5b226e887 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:29.484781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:29.536790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:29.641111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd735f-6a93-43cc-bfb8-ecf88cddb22a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.641276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd735f-6a93-43cc-bfb8-ecf88cddb22a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.641569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd735f-6a93-43cc-bfb8-ecf88cddb22a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.643281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 89/178] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:29.650754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2917fe-4b67-4e67-99f1-342341344353 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:29.658029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.658380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.658608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.693006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:29.694422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:29.744829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93ae36-f36f-451b-90e9-2416f46f523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:29.745500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93ae36-f36f-451b-90e9-2416f46f523b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.745782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93ae36-f36f-451b-90e9-2416f46f523b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.746056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93ae36-f36f-451b-90e9-2416f46f523b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.818575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:29.840936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 90/179] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:29.861799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93ae36-f36f-451b-90e9-2416f46f523b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:29.863290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93ae36-f36f-451b-90e9-2416f46f523b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:29.875365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:29.900043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:29.983442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 90/180] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:29.991046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e81a-4bce-4cbd-8b42-828e43f22d2f None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:29.991338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e81a-4bce-4cbd-8b42-828e43f22d2f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:29.991610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e81a-4bce-4cbd-8b42-828e43f22d2f None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:29.993088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 91/181] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:29.993865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e81a-4bce-4cbd-8b42-828e43f22d2f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.076973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48f64-bcc4-4098-9a4a-22c4faa8fcec None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.110546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e81a-4bce-4cbd-8b42-828e43f22d2f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.115923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e0c41-78e2-4168-a731-614751fc0cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.116721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0c41-78e2-4168-a731-614751fc0cee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.117000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0c41-78e2-4168-a731-614751fc0cee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.117274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0c41-78e2-4168-a731-614751fc0cee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.128631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e0c41-78e2-4168-a731-614751fc0cee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-703e0c41-78e2-4168-a731-614751fc0cee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:30.136602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:30.137609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:30.138561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 91/182] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:30.139360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.139360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.141823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.142641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.149865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137d8c4-dd26-49ba-8637-60be02363831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.150736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137d8c4-dd26-49ba-8637-60be02363831 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.151096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137d8c4-dd26-49ba-8637-60be02363831 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.151381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137d8c4-dd26-49ba-8637-60be02363831 None admin] PATH_INFO: `/v3/projects/1079caea119c4fd1a107370aa337439c` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.152603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137d8c4-dd26-49ba-8637-60be02363831 None admin] RBAC: Authorizing `identity:get_project(project_id=1079caea119c4fd1a107370aa337439c)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:30.154332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137d8c4-dd26-49ba-8637-60be02363831 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:30.156263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 92/183] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:29 2022] GET /identity/v3/projects/1079caea119c4fd1a107370aa337439c => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:30.163214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:30.164628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:30.164911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391083-7106-4433-b381-539edc8ba94d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.166684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391083-7106-4433-b381-539edc8ba94d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.166989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391083-7106-4433-b381-539edc8ba94d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.169767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 93/184] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:30.170340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91391083-7106-4433-b381-539edc8ba94d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.215450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.237100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 92/185] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:30.237990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.282333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91391083-7106-4433-b381-539edc8ba94d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.318730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.319474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.319791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.320112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.320943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:30.321302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:30.322901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7601-dc28-48b3-b92c-67f6313ae0a7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:30.331553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 94/186] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:30.334605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.335066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.335341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.343925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3050f-9e41-4414-872f-8078878e4db0 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.356199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:30.357444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:30.383090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.383766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.384051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.384332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.385158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=1079caea119c4fd1a107370aa337439c, user.id=3a4b9074f6ee42cea226d3c5b226e887) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:30.385469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:30.386908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda754ce-88d4-4aeb-afe9-7cb4dc5770d5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:30.393373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 93/187] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/role_assignments?user.id=3a4b9074f6ee42cea226d3c5b226e887&scope.project.id=1079caea119c4fd1a107370aa337439c&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:30.394861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1f8ac-063f-44f8-9e47-c00cf1b36201 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.395823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1f8ac-063f-44f8-9e47-c00cf1b36201 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.396156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1f8ac-063f-44f8-9e47-c00cf1b36201 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.397627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 94/188] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:30.398424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1f8ac-063f-44f8-9e47-c00cf1b36201 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.437318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.459660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 95/189] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:30.459660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.466605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.531264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1f8ac-063f-44f8-9e47-c00cf1b36201 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.569594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4414f-a3b4-467a-b2f0-af5ce9b8b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.570427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4414f-a3b4-467a-b2f0-af5ce9b8b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.570707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4414f-a3b4-467a-b2f0-af5ce9b8b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.570983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4414f-a3b4-467a-b2f0-af5ce9b8b9d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.585784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4414f-a3b4-467a-b2f0-af5ce9b8b9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:30.586705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bacab6-e3c3-4f47-b674-da9ae1bb895f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f5d4414f-a3b4-467a-b2f0-af5ce9b8b9d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:30.594157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:30.595312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:30.596350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 95/190] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:30.598269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.598269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.598269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.617695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:30.618914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:30.626726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.627605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.627916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.628213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] PATH_INFO: `/v3/users/0307d636a22349798c5adfb9de0b0224` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.644083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] RBAC: Authorizing `identity:get_user(user_id=0307d636a22349798c5adfb9de0b0224)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:30.645682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:30.647405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 96/191] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/users/0307d636a22349798c5adfb9de0b0224 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:30.649209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.695237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 96/192] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:30.696126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.710811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.733101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.762289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c76e8-c14d-4e95-b508-deadb617d96b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.796122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.796914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.797198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.797479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.798651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:30.800169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:30.802382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 97/193] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:30.803138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.803681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c2de0-00f1-411a-b6dd-59e234b6c5e7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.837920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.838673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.838935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.839130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.839906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:30.840214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:30.841629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:30.849704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 97/194] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:30.850506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:30.906057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe684d40-b2e7-49a1-8eec-97d8e8f0425c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.924381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.941691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.942980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.943260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.943532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:30.951283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:30.957856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31822-9bcd-4ce3-ba15-561191aeadf0 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:30.991465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:30.992276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:30.992558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:30.992833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.003185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:31.010756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:31.010933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:31.012021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:31.017677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 98/195] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:31.018384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.018454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.111826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 98/196] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:31.112759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.117017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06dc5f-4e77-43aa-9256-7ba42d241ed0 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.131487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.150491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.151159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.151445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.151757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.152797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.153931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.173598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 99/197] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:31 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:31.187833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.191865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.234342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ee54-9025-4a10-85f7-39d9f89f8a9a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.271690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.272630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.272923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.273200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] PATH_INFO: `/v3/users/0307d636a22349798c5adfb9de0b0224` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.274520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] RBAC: Authorizing `identity:get_user(user_id=0307d636a22349798c5adfb9de0b0224)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.276101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.277831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 99/198] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/users/0307d636a22349798c5adfb9de0b0224 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:31.278700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.297100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee4b20-dc08-4999-aae4-7f3372f4fd18 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.334777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.335586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.335906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.336189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.336959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:31.337272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.338846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.349329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 100/199] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:31.352569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.377216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.398602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dc1b-b541-477a-a353-1bc9d76f7c4a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.436364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.437239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.437519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.437792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.439510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.441093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.442823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 100/200] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:31.443601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.446727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.480300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0c41-95d0-4baa-bd62-2361d5e945f2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.523486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.524518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.524949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.525370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.584778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f549b-f3b6-4af7-9a00-449c06a6f783 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.616695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.618352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.634240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.635886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.636180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.636465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] PATH_INFO: `/v3/users/9092fbcc222e4c29b1c8c14418190442` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.638027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=9092fbcc222e4c29b1c8c14418190442)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.639962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.642366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 101/201] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/users/9092fbcc222e4c29b1c8c14418190442 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:31.643649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.678415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.701114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.737125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 101/202] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:31.738215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.786525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe51e-d57c-4e5b-a467-4571079f5cd0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.826241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:31.827026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:31.827441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:31.827829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:31.828763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=0307d636a22349798c5adfb9de0b0224) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:31.829120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:31.831055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:31.838258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 102/203] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/role_assignments?user.id=0307d636a22349798c5adfb9de0b0224&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:31.838980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:31.902755 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc99c-02b3-4239-b8c2-49fb7524fc7f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:31.976561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:31.997428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b8720-f04b-49f2-a67f-e5f950ddec76 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:32.028413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:32.029395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:32.029680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:32.029959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:32.043382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:32.045094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:32.046439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:32.046743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:32.049103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:32.050738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:32.053097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 103/204] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:32.058780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:32.107997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:32.125260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:32.126984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:32.234541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a35c-36f3-45ef-b53d-27788f06b378 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:32.239549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 102/205] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:32.245045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:32.312411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:32.312999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:32.313287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:32.313567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:32.314408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] RBAC: Adding query filter params (role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=0307d636a22349798c5adfb9de0b0224) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:32.314724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:32.316230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:32.322320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 104/206] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:32 2022] GET /identity/v3/role_assignments?user.id=0307d636a22349798c5adfb9de0b0224&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:32.322859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:32.350100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aba919-86eb-4b9b-bed7-d0511eb2e1a2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:32.389715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32369c6c-b7d9-42e5-b9e4-5549d208e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:32.390603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369c6c-b7d9-42e5-b9e4-5549d208e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:32.390901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369c6c-b7d9-42e5-b9e4-5549d208e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:32.391159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369c6c-b7d9-42e5-b9e4-5549d208e4b6 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:32.392415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369c6c-b7d9-42e5-b9e4-5549d208e4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:32.399306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369c6c-b7d9-42e5-b9e4-5549d208e4b6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:32.402969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 103/207] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:32 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:32.409126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:32.429636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:32.573948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020288-67ea-444c-b64e-399c38a638eb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:32.633771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:32.634440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:32.634729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:32.635005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:32.635874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] RBAC: Adding query filter params (role.id=0bab154d01a142039b70426c79b3fc0a, scope.project.id=2e3ab599465546119d3df661adb91307, user.id=9092fbcc222e4c29b1c8c14418190442) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:32.636193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:32.637749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d7758-78c8-47c2-ba61-ff22e016e6d3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:32.647731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 105/208] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:32 2022] GET /identity/v3/role_assignments?user.id=9092fbcc222e4c29b1c8c14418190442&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=0bab154d01a142039b70426c79b3fc0a => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:33.742072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a083c-2cb9-423b-9f5b-708d53cda3ec None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:33.742592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a083c-2cb9-423b-9f5b-708d53cda3ec None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:33.742703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a083c-2cb9-423b-9f5b-708d53cda3ec None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:33.744283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 104/209] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:33.749774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:33.750282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:33.750432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:33.767811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:33.769001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:33.827734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681cd8d-1347-42a8-b596-dd0e6adc86a9 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:33.828057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681cd8d-1347-42a8-b596-dd0e6adc86a9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:33.828291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681cd8d-1347-42a8-b596-dd0e6adc86a9 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:33.829886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 105/210] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:33.835398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:33.835868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:33.836157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:33.841967 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 106/211] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:33.853553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:33.854992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:33.867094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:33.882640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:33.955643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:33.977173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:33.991836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccb4bc-5610-4e04-a19d-4c49da5ec904 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.034360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.036149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.036639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.037347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.038962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:34.041019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:34.043368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 107/213] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:34.049951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.064571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.105004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54e929-df71-4c9a-a85c-3a9079cec193 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.146087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.147992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.149545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.149841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.150184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.164301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:34.171275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fc0c-ca95-4b82-82bf-abd4e11a688f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:34.175516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:34.176654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:34.177632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:34.183481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 107/214] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:34.185275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.225960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a913a-a9e8-417e-8bfa-c411ec8fa2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.227463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a913a-a9e8-417e-8bfa-c411ec8fa2e4 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.227789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a913a-a9e8-417e-8bfa-c411ec8fa2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.228073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a913a-a9e8-417e-8bfa-c411ec8fa2e4 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.228806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a913a-a9e8-417e-8bfa-c411ec8fa2e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:34.230288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a913a-a9e8-417e-8bfa-c411ec8fa2e4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:34.275758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 108/215] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:34 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:34.315480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29812021-2ca4-4f73-8590-05ffaa0916a1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.353168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.359543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.360306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.360598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.360882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.361704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:34.362021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:34.364075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:34.367090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3ddcc-11e9-45d2-be09-4be806483338 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.367379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3ddcc-11e9-45d2-be09-4be806483338 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.367683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3ddcc-11e9-45d2-be09-4be806483338 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.369277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 109/216] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:34.374105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 108/217] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:34.374591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.374879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.375156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.381593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.393409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:34.394617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:34.470130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 110/218] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:34.493662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.524592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd099e9-b149-426a-8d61-2f2eb9e81267 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.568190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.568976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.569265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.569544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] PATH_INFO: `/v3/users/1f61daeddd484e97aa408cc1042983a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.582390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.591473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] RBAC: Authorizing `identity:get_user(user_id=1f61daeddd484e97aa408cc1042983a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:34.593035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:34.594807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 109/219] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:34 2022] GET /identity/v3/users/1f61daeddd484e97aa408cc1042983a6 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:34.601289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.640089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cc026-1944-403b-b560-04dd2a7bfc78 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.671333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.696044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.696944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.697299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.697654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.712178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:34.720067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:34.720982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:34.721947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 111/220] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:34.731845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.745959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b491fe3-540c-4cdb-bfa4-af4c62e59218 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.784656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848dc14-7d85-4f03-a889-448c30cb0a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.785866 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848dc14-7d85-4f03-a889-448c30cb0a67 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.786177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848dc14-7d85-4f03-a889-448c30cb0a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.786455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848dc14-7d85-4f03-a889-448c30cb0a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.860685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f139969-a9fd-4e82-ae96-4faaccd7280e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:34.866957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848dc14-7d85-4f03-a889-448c30cb0a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:34.868608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848dc14-7d85-4f03-a889-448c30cb0a67 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:34.888712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.899494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:34.900201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.900484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.900760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.901831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:34.902142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:34.903568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b434e-8c23-41d8-8d9b-41007e16b37c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:34.916772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 112/221] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:34.918255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f5c2-1663-4044-a050-3cef14de06c2 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.918550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f5c2-1663-4044-a050-3cef14de06c2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.918827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f5c2-1663-4044-a050-3cef14de06c2 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:34.920256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 113/222] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:34.920966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f5c2-1663-4044-a050-3cef14de06c2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:34.932386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:34.986133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 110/223] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:34.987496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:34.987782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:34.988064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.005955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:35.007145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:35.038204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f5c2-1663-4044-a050-3cef14de06c2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.074984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.076147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.076607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.077023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] PATH_INFO: `/v3/users/0307d636a22349798c5adfb9de0b0224` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.078447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] RBAC: Authorizing `identity:get_user(user_id=0307d636a22349798c5adfb9de0b0224)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.080126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.082264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 114/224] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:34 2022] GET /identity/v3/users/0307d636a22349798c5adfb9de0b0224 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:35.083215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.088073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 111/225] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:35.089104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.147081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:35.179981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:35.194557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca2fe-511b-46c3-b72a-f40ac62990cf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.199403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6df0-54d1-4e87-91ba-8f789a00a23e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.230465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.231340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.231641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.231997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.233247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.234946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.241270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 115/226] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:35.241270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.244429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.245582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.246045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.246555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.248037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.249734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.251781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:35.257408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.345826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048061c-a1b3-4aab-8cac-569a4181827b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.369834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:35.373431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996004b8-1825-453f-a87c-10ed38d90271 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.381806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.382626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.382906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.383179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.393941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:35.402306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:35.403208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:35.404311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 116/228] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:35.404969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.416246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.417128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.417648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.418154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.419299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=1f61daeddd484e97aa408cc1042983a6) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:35.419859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.421536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.428519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 113/229] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/role_assignments?user.id=1f61daeddd484e97aa408cc1042983a6&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:35.429618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.456057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:35.519655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47caf2-3cdc-4b84-834a-6745914953a5 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.556096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.556997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.557302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.557559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/0307d636a22349798c5adfb9de0b0224/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.559711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] RBAC: Authorizing `identity:create_grant(project_id=76422a4580c642aba304d169fbc7cc5d, user_id=0307d636a22349798c5adfb9de0b0224, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.561270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.584387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 117/230] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:35 2022] PUT /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/0307d636a22349798c5adfb9de0b0224/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:35.591917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802181-e575-47d4-8807-0592f1f9133b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.638488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.639178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.639462 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.639773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.640536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:35.640844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.642274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.656457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 114/231] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:35.662561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.724544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:35.786733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365ce3-75de-4da5-bb35-e83bec5282ed None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:35.824235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:35.825170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:35.825456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:35.825842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] PATH_INFO: `/v3/users/0307d636a22349798c5adfb9de0b0224` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:35.827027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] RBAC: Authorizing `identity:get_user(user_id=0307d636a22349798c5adfb9de0b0224)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:35.828557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:35.830547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 118/232] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/users/0307d636a22349798c5adfb9de0b0224 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:35.836291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:35.948880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:35.975383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06e7c0-119a-40da-a37e-2cc6f03d7f77 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:36.011875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0ddf7-bef5-4fc8-9b74-07d6d30d364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:36.012785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ddf7-bef5-4fc8-9b74-07d6d30d364d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:36.013073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ddf7-bef5-4fc8-9b74-07d6d30d364d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:36.013341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ddf7-bef5-4fc8-9b74-07d6d30d364d None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:36.014538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0ddf7-bef5-4fc8-9b74-07d6d30d364d None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:36.016028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0ddf7-bef5-4fc8-9b74-07d6d30d364d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:36.018034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 115/233] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:35 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:36.023976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:36.152921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83c1e-97fc-4b27-afc7-24b523486147 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:36.171107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:36.192518 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f82cf-440e-4de9-8d95-8ee6edfbad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:36.193442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f82cf-440e-4de9-8d95-8ee6edfbad41 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:36.194642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f82cf-440e-4de9-8d95-8ee6edfbad41 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:36.194642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f82cf-440e-4de9-8d95-8ee6edfbad41 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/0307d636a22349798c5adfb9de0b0224/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:36.196849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f82cf-440e-4de9-8d95-8ee6edfbad41 None admin] RBAC: Authorizing `identity:create_grant(project_id=76422a4580c642aba304d169fbc7cc5d, user_id=0307d636a22349798c5adfb9de0b0224, role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:36.199195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f82cf-440e-4de9-8d95-8ee6edfbad41 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:36.216128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 119/234] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:36 2022] PUT /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/0307d636a22349798c5adfb9de0b0224/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:37.028269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2c01-3eaa-45a6-a172-bdb69ef92192 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.028784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2c01-3eaa-45a6-a172-bdb69ef92192 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.029121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2c01-3eaa-45a6-a172-bdb69ef92192 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.030761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 116/235] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:37.036897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ca3a-4b17-40be-814a-9b28a0111a3c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.037436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ca3a-4b17-40be-814a-9b28a0111a3c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.037436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ca3a-4b17-40be-814a-9b28a0111a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.060303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9939ca3a-4b17-40be-814a-9b28a0111a3c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:37.061493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9939ca3a-4b17-40be-814a-9b28a0111a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:37.160668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 120/236] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:37.182961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635901b-d91d-411b-95d7-8d31336ceee4 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.183289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635901b-d91d-411b-95d7-8d31336ceee4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.183519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635901b-d91d-411b-95d7-8d31336ceee4 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.185195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 117/237] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:37.190376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.190667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.190953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.198083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635901b-d91d-411b-95d7-8d31336ceee4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:37.220730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:37.222054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:37.316340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635901b-d91d-411b-95d7-8d31336ceee4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:37.361261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:37.385031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:37.386116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.386571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.387078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.404790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:37.413138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:37.414255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:37.415233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:37.417515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 118/239] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:37.423522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:37.434593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:37.444039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:37.463508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:37.588036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be917d-1d3f-48ae-90ee-1372add0222f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:37.624987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:37.625712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.626183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.626468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.627262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:37.631783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:37.632594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4828-b1f7-42ae-b141-aec2fc25dd2e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:37.633308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:37.650731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 122/240] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:37.657310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:37.702403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:37.703566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.704648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.705129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.706534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:37.708261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:37.711037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 119/241] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:37.716335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:37.850510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:37.857325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:37.866816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cfbcd-ef9e-4d48-801e-e616009844f0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:37.919955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d382493-7d3b-498f-a02c-930cfda83b19 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:37.946740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:37.947887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.948309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.948727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] PATH_INFO: `/v3/users/74b8c954974e439f809c49c95d7e3ce0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.975484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] RBAC: Authorizing `identity:get_user(user_id=74b8c954974e439f809c49c95d7e3ce0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:37.976957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:37.978813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 123/242] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:37 2022] GET /identity/v3/users/74b8c954974e439f809c49c95d7e3ce0 => generated 297 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:37.984817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:37.990584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3565e8a-df40-4302-bc54-5119dfba629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:37.991264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3565e8a-df40-4302-bc54-5119dfba629c None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:37.991551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3565e8a-df40-4302-bc54-5119dfba629c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:37.991852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3565e8a-df40-4302-bc54-5119dfba629c None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:37.992572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3565e8a-df40-4302-bc54-5119dfba629c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:37.994281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3565e8a-df40-4302-bc54-5119dfba629c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:38.041102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 120/243] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:37 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:38.148970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072b982-d5a4-4bb3-a4d2-e4e58ebc9d50 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:38.207917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:38.209024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.209316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.209571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.248995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:38.316618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:38.318310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:38.345380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76deaf-20d7-4e1f-85e0-fb6ef1da1888 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.345701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76deaf-20d7-4e1f-85e0-fb6ef1da1888 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.345951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76deaf-20d7-4e1f-85e0-fb6ef1da1888 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.347430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 121/244] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:38.364371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.364712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.364933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.404098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:38.404098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:38.480403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 124/245] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:38.486082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:38.517061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 122/246] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:38.541578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:38.557964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:38.618894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f2e2-acd4-4eef-94f6-4e3a36b51997 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:38.627838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:38.666208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:38.667338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.667866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.668301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.669834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:38.671864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:38.674158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 125/247] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:38 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:38.682050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:38.685318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c3fa0-afba-4636-81ea-796883249d9f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:38.726674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4ac8-b6af-4549-b6f9-1b0acab9b310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:38.727479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4ac8-b6af-4549-b6f9-1b0acab9b310 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.727790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4ac8-b6af-4549-b6f9-1b0acab9b310 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.728062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4ac8-b6af-4549-b6f9-1b0acab9b310 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.742443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc4ac8-b6af-4549-b6f9-1b0acab9b310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-21fc4ac8-b6af-4549-b6f9-1b0acab9b310 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:38.752920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:38.754412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:38.755927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 123/248] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:38.757047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0faf-5f03-4691-944a-c4cfc39a4dd9 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.757047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0faf-5f03-4691-944a-c4cfc39a4dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.757180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0faf-5f03-4691-944a-c4cfc39a4dd9 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.759059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 124/249] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:38.764594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0faf-5f03-4691-944a-c4cfc39a4dd9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:38.827843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991fc09-14fe-440c-a5a1-9dfb2eef7bc8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:38.853892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:38.872950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:38.873704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.873991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.874263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.875193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] RBAC: Adding query filter params (role.id=0bab154d01a142039b70426c79b3fc0a, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=74b8c954974e439f809c49c95d7e3ce0) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:38.875598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:38.878144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539608ca-d112-462c-a189-bf60879baf43 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:38.885460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 126/250] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:38 2022] GET /identity/v3/role_assignments?user.id=74b8c954974e439f809c49c95d7e3ce0&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=0bab154d01a142039b70426c79b3fc0a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:38.886865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.887375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.887723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.911085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:38.912695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:38.944396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0faf-5f03-4691-944a-c4cfc39a4dd9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:38.970801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:38.997548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:38.998250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:38.998644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:38.998930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:38.999952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:39.000269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:39.002483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:39.018606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 125/251] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:39.025868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.031450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 127/252] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:39.082460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.213269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0723c-3893-4a3d-9b18-0de8f645cf42 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:39.251117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72057913-f274-4229-b479-dbbe6b932f3e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:39.276063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:39.293199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:39.294352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.294830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.295294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.296605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84a6d2-5335-4e02-9826-3e5b937620c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:39.297517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84a6d2-5335-4e02-9826-3e5b937620c4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.297927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84a6d2-5335-4e02-9826-3e5b937620c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.298100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84a6d2-5335-4e02-9826-3e5b937620c4 None admin] PATH_INFO: `/v3/users/1f61daeddd484e97aa408cc1042983a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.300223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84a6d2-5335-4e02-9826-3e5b937620c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1f61daeddd484e97aa408cc1042983a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:39.302515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84a6d2-5335-4e02-9826-3e5b937620c4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:39.308561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 126/253] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:39 2022] GET /identity/v3/users/1f61daeddd484e97aa408cc1042983a6 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:39.308561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107feae-6a95-40e2-8220-55109f8a3551 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.308561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107feae-6a95-40e2-8220-55109f8a3551 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.308561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107feae-6a95-40e2-8220-55109f8a3551 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.312201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 127/254] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:39.313892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.314072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.314314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.334189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:39.335317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:39.336281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:39.352147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:39.353146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:39.354215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 128/255] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:39.355053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.406258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:39.452219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 128/256] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:39.452873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.536833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36855-9865-4d63-b13e-18b56fdc8a34 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:39.599999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:39.600773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.601051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.601320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.603247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:39.604773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:39.608278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 129/257] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:39 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:39.609076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.639829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c925e92-cce8-477e-af3c-c7a122d7ceaa None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:39.703038 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:39.704176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.704684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.705161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.708736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:39.709269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:39.710905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:39.720026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:39.742595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 129/258] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:39.743574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.795089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:39.860018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73372c6-36c8-483a-9479-085275ce175c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:39.869567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee9e6-0b66-46a1-869e-94652e5c70ad None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:39.905543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:39.906460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.906747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.907024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/1f61daeddd484e97aa408cc1042983a6/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.909959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=76422a4580c642aba304d169fbc7cc5d, user_id=1f61daeddd484e97aa408cc1042983a6, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:39.912052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:39.936380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 130/259] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:39 2022] PUT /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/1f61daeddd484e97aa408cc1042983a6/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:39.938239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:39.943188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:39.945243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:39.945529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:39.947060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:39.973783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:39.992342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:39.993319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:39.994120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:39.999249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 130/260] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:40.005599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:40.161633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:40.165615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c42b6-763b-49aa-988f-288ae6066a6f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:40.230936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e427b3-69c5-44ea-8240-b5846af919c1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:40.234823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:40.243105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:40.244023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:40.244303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:40.244575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] PATH_INFO: `/v3/users/0307d636a22349798c5adfb9de0b0224` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:40.245795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] RBAC: Authorizing `identity:get_user(user_id=0307d636a22349798c5adfb9de0b0224)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:40.247249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:40.249306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 131/261] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:39 2022] GET /identity/v3/users/0307d636a22349798c5adfb9de0b0224 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:40.255495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:40.340355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:40.341727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:40.342214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:40.342725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:40.343608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:40.344038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:40.345538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:40.355164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 131/262] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:40.360605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:40.394128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449bf6b-b75a-44be-8ac5-185f487dec5a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:40.454177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:40.455746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:40.456211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:40.456660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:40.530235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:40.595860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:40.597473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:40.625579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11703-a367-493f-8033-8c0deb3428bf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:40.728443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:40.729254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:40.729540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:40.729819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] PATH_INFO: `/v3/users/0307d636a22349798c5adfb9de0b0224` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:40.731081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] RBAC: Authorizing `identity:get_user(user_id=0307d636a22349798c5adfb9de0b0224)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:40.739641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:40.739641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 132/263] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:40 2022] GET /identity/v3/users/0307d636a22349798c5adfb9de0b0224 => generated 283 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:40.747748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:40.754268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 132/264] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:18:40.764680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:40.820938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:40.940629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:41.006555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcf72b-bf8c-48f4-8251-726f3b9af206 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:41.014226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ec27-677e-4509-b092-5fccf0fa45dd None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:41.079185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:41.079871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.080157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.080434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.082864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:41.083765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.084046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.084321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.087373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:41.088880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:41.090846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 133/265] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:40 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:41.102948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:41.270340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:41.275877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:41.317990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfdb5b-4b9c-4588-bd3f-1bba3b2cc542 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:41.356912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:41.449864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:41.450562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.450868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.451145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.452085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=0307d636a22349798c5adfb9de0b0224) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:41.452423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:41.453970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:41.466429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:41.482397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 134/266] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:41 2022] GET /identity/v3/role_assignments?user.id=0307d636a22349798c5adfb9de0b0224&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:41.514776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 133/267] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:18:41.521086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:41.650605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27d007-2604-4ea3-8be9-e23ffb488b6a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:41.687827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83eb46-4fe2-4f7f-97b1-94ef0eb334d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:41.688699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83eb46-4fe2-4f7f-97b1-94ef0eb334d1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.688980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83eb46-4fe2-4f7f-97b1-94ef0eb334d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.689256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83eb46-4fe2-4f7f-97b1-94ef0eb334d1 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.690475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83eb46-4fe2-4f7f-97b1-94ef0eb334d1 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:41.692532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83eb46-4fe2-4f7f-97b1-94ef0eb334d1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:41.694630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 135/268] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:41 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:41.700257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:41.715901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba81cf-81ee-4838-9928-9fbb506a9b9f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.716215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba81cf-81ee-4838-9928-9fbb506a9b9f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.716464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba81cf-81ee-4838-9928-9fbb506a9b9f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.717878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 136/269] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:41.727704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4236-6a03-47d2-b6fb-f938197a3261 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.727998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4236-6a03-47d2-b6fb-f938197a3261 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.728280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4236-6a03-47d2-b6fb-f938197a3261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.759762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-83ee4236-6a03-47d2-b6fb-f938197a3261 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:41.761203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-83ee4236-6a03-47d2-b6fb-f938197a3261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:41.886657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cb128-6430-4078-aa3c-550446e6dbb2 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:41.908635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:41.925471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 137/270] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:41.925471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424a1e-a3a5-4e53-808e-a5f67bff67f1 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.926295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424a1e-a3a5-4e53-808e-a5f67bff67f1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.926415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424a1e-a3a5-4e53-808e-a5f67bff67f1 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.928425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 138/271] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:41.938194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:41.941363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.942185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.942466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.954915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:41.955592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:41.955898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:41.956174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:41.957063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] RBAC: Adding query filter params (role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=0307d636a22349798c5adfb9de0b0224) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:41.957378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:41.958891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:41.968781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:41.970002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:41.970518 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 134/272] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:41 2022] GET /identity/v3/role_assignments?user.id=0307d636a22349798c5adfb9de0b0224&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:41.971488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.102997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:42.109040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc10bc-5dd0-42db-8ad1-8431abaa54cf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.148914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729336f0-6264-403f-9cc7-17bf22f91e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.150422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.154278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729336f0-6264-403f-9cc7-17bf22f91e0d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.154557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729336f0-6264-403f-9cc7-17bf22f91e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.159805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729336f0-6264-403f-9cc7-17bf22f91e0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.178200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729336f0-6264-403f-9cc7-17bf22f91e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-729336f0-6264-403f-9cc7-17bf22f91e0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:42.187230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:42.189941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:42.190952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:42.200252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 135/274] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:42.201622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b1ec-3dde-425f-a430-e07346f40cdc None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.201907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b1ec-3dde-425f-a430-e07346f40cdc None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.202183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b1ec-3dde-425f-a430-e07346f40cdc None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.203873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 136/275] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:42.206321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b1ec-3dde-425f-a430-e07346f40cdc None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.275705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:42.280557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa58480-c7d2-4aa5-9608-13d835a39b9a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.317352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:42.328053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a93ca8-01bb-4afe-b9f0-ab954f56f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.328939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93ca8-01bb-4afe-b9f0-ab954f56f0ba None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.329302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93ca8-01bb-4afe-b9f0-ab954f56f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.329652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93ca8-01bb-4afe-b9f0-ab954f56f0ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.330920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a93ca8-01bb-4afe-b9f0-ab954f56f0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:42.333102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a93ca8-01bb-4afe-b9f0-ab954f56f0ba None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:42.333211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b1ec-3dde-425f-a430-e07346f40cdc None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.334839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 140/276] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:42.336166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.336576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.336924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.363189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:42.364946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:42.386131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.386821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.387024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.387302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.388271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:42.388630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:42.390667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:42.406549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 137/277] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:42.407250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.459648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 141/278] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:42.459648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.533891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa01b-33fe-4b10-97b6-3331125ef9bb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.552305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:42.554328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454a6e-12d8-469e-8756-8b841b1f442a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.573365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.574373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.574962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.575414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.576313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:42.578235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:42.580465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:42.590550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.591431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.591912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.592022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] PATH_INFO: `/v3/users/9263a31d56554bb5b13eae433d4fb3e5` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.615654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 138/279] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:18:42 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:42.615654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.619901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=9263a31d56554bb5b13eae433d4fb3e5)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:42.621519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:42.624514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 142/280] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:42 2022] GET /identity/v3/users/9263a31d56554bb5b13eae433d4fb3e5 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:42.631254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.734648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02e693-00f1-4d2f-a770-5f1d354e25bc None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.775274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.776174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.776458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.776750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.780672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8943c7-c943-4ca7-916e-70e5784a2ad5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:42.789454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:42.797647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:42.798608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:42.805741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 139/281] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:42.808411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:42.836639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:42.837296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:42.837583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:42.837847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:42.838714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, user.id=9263a31d56554bb5b13eae433d4fb3e5, scope.system=all) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:42.839023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:42.840596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:42.846699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 143/282] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 19 16:18:42 2022] GET /identity/v3/role_assignments?user.id=9263a31d56554bb5b13eae433d4fb3e5&scope.system=all&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:42.856843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:42.959403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d568-5de5-4645-a935-8ee04cb7009a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:43.001556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:43.002488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.002920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.003342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.004379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:43.004838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:43.006442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:43.016921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 140/283] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:43.022714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:43.080473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:43.138430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d62b9-4ee8-427c-814c-dc91584d3cee None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:43.177893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6aa0-c772-44b5-a375-5496d2489b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:43.178778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6aa0-c772-44b5-a375-5496d2489b77 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.179063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6aa0-c772-44b5-a375-5496d2489b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.179340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6aa0-c772-44b5-a375-5496d2489b77 None admin] PATH_INFO: `/v3/users/74b8c954974e439f809c49c95d7e3ce0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.180609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6aa0-c772-44b5-a375-5496d2489b77 None admin] RBAC: Authorizing `identity:get_user(user_id=74b8c954974e439f809c49c95d7e3ce0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:43.182087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6aa0-c772-44b5-a375-5496d2489b77 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:43.187754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 144/284] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:43 2022] GET /identity/v3/users/74b8c954974e439f809c49c95d7e3ce0 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:43.190293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:43.194432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f227-c466-48de-8a5c-0b512657fc5d None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.194802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f227-c466-48de-8a5c-0b512657fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.195153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f227-c466-48de-8a5c-0b512657fc5d None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.197420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 145/285] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:43.203799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.204135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.204455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.239574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:43.241084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:43.391588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:43.402127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fbe3d-0a41-4d44-9cc1-6caba2e2f17b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:43.407424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 146/286] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:43.446300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:43.456707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:43.463281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.463281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.463281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.463281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:43.463281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:43.463674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 141/287] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:43 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:43.471043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:43.565804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:43.617865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dfc04-8c28-4981-bbed-b2c72ee43407 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:43.679931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac25dd-24c9-4103-92b2-7019523cff8e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:43.696331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:43.697584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.698067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.698559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/74b8c954974e439f809c49c95d7e3ce0/roles/0bab154d01a142039b70426c79b3fc0a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.705009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] RBAC: Authorizing `identity:create_grant(project_id=76422a4580c642aba304d169fbc7cc5d, user_id=74b8c954974e439f809c49c95d7e3ce0, role_id=0bab154d01a142039b70426c79b3fc0a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:43.706490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:43.723210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:43.724352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.724705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.724984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.731091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 142/288] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:18:43 2022] PUT /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d/users/74b8c954974e439f809c49c95d7e3ce0/roles/0bab154d01a142039b70426c79b3fc0a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:18:43.737726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:43.746192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:43.747130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:43.747956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:43.751500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 147/289] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:43.755154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:43.785742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:43.887245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650cd30-d6f9-4eb1-a728-50093009c56c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:43.942223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:43.942847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:43.943127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:43.943403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:43.944185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:43.944491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:43.945891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:43.955593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 143/290] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:43.961787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:44.121725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42454d-776d-4d78-a4ef-0ebefa54bc5f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:44.131703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:44.163263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:44.164313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:44.164610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:44.164891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] PATH_INFO: `/v3/users/1f61daeddd484e97aa408cc1042983a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:44.166122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] RBAC: Authorizing `identity:get_user(user_id=1f61daeddd484e97aa408cc1042983a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:44.167600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:44.169633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 148/291] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:43 2022] GET /identity/v3/users/1f61daeddd484e97aa408cc1042983a6 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:44.175457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:44.325013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:44.347356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603489e2-d5c7-4048-b6ce-4dc639b4a790 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:44.396589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:44.397300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:44.397536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:44.397809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:44.504596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:44.506095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:44.617529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:44.636966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 144/292] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:44.643576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:44.793808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe8f6-f2fe-4e6b-a708-cb23d8fb9417 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:44.836784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8433187-89fe-4f08-852b-66438077c908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:44.837652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433187-89fe-4f08-852b-66438077c908 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:44.837937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433187-89fe-4f08-852b-66438077c908 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:44.838214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433187-89fe-4f08-852b-66438077c908 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:44.839420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433187-89fe-4f08-852b-66438077c908 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:44.840923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433187-89fe-4f08-852b-66438077c908 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:44.842936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 149/293] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:44 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:44.849190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:44.997839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888f46-511f-4f43-b6f6-e23e9cdcf83f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:45.047069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:45.047758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:45.048036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:45.048308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:45.049139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=1f61daeddd484e97aa408cc1042983a6) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:45.049446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:45.050954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a19aae-9e1d-4ce9-8209-7c2f98c0fc7c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:45.060537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 145/294] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:44 2022] GET /identity/v3/role_assignments?user.id=1f61daeddd484e97aa408cc1042983a6&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:45.517172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ad86-fd87-4625-aedb-e32255cedc71 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:45.517452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ad86-fd87-4625-aedb-e32255cedc71 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:45.517941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ad86-fd87-4625-aedb-e32255cedc71 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:45.520316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 150/295] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:45.525755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa088247-fae3-4449-91e5-8542e9a8b906 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:45.526520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa088247-fae3-4449-91e5-8542e9a8b906 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:45.526955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa088247-fae3-4449-91e5-8542e9a8b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:45.546201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-fa088247-fae3-4449-91e5-8542e9a8b906 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:45.548303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fa088247-fae3-4449-91e5-8542e9a8b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:45.605939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:45.633636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 146/296] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:45.657612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120ad86-fd87-4625-aedb-e32255cedc71 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:45.721618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:45.798623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120ad86-fd87-4625-aedb-e32255cedc71 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:45.806249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f58e6-fb95-41b8-bfa8-fe7bb1856a42 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:45.806556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f58e6-fb95-41b8-bfa8-fe7bb1856a42 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:45.806802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f58e6-fb95-41b8-bfa8-fe7bb1856a42 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:45.808411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 147/297] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:45.814078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:45.814361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:45.814639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:45.834133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:45.835309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:45.854837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:45.856589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:45.857406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:45.857890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:45.873879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:45.885677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:45.886659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:45.887478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:45.895834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 151/298] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:45.899369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:45.930085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 148/299] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:45.953788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.024003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0fc90-764a-420d-841d-ad1d7fc4707a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.025647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.062778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.063392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b4c52-9efa-481f-bfed-284e7d6045b6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.063500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.063714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.063986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.064731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:46.065039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.066530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33845a19-8939-44a5-abe2-4a7e5886edf3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.075243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 152/300] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:46.075452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.077078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae1ec-1978-45af-b3b4-0ed25b8efb99 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.077403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae1ec-1978-45af-b3b4-0ed25b8efb99 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.077658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae1ec-1978-45af-b3b4-0ed25b8efb99 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.079115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 153/301] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:46.083803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ae1ec-1978-45af-b3b4-0ed25b8efb99 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.105024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2feaea-93cd-4c0a-9da5-48018eeba7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.105818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2feaea-93cd-4c0a-9da5-48018eeba7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.106094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2feaea-93cd-4c0a-9da5-48018eeba7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.106484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2feaea-93cd-4c0a-9da5-48018eeba7e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.118497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2feaea-93cd-4c0a-9da5-48018eeba7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-3b2feaea-93cd-4c0a-9da5-48018eeba7e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:46.126711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:46.127673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:46.128481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 149/302] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:46.129726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.129726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.129879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.156259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:46.157563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:46.218909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ae1ec-1978-45af-b3b4-0ed25b8efb99 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.264112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 150/303] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:46.264112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.268474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.269988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.270279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.270560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] PATH_INFO: `/v3/users/9263a31d56554bb5b13eae433d4fb3e5` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.272542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] RBAC: Authorizing `identity:get_user(user_id=9263a31d56554bb5b13eae433d4fb3e5)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.274285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.277047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 154/304] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:46 2022] GET /identity/v3/users/9263a31d56554bb5b13eae433d4fb3e5 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:46.282517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.324210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.380115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.383820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360926f7-0b80-4809-98ea-01811af10d13 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.397191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540674d-1728-46c2-b7ac-2db4122c5b8a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.420712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.421423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.421651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.421921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.422666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:46.422969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.424399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.434230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 151/305] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:46.434230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.438656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.439539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.439860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.440144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] PATH_INFO: `/v3/system/users/9263a31d56554bb5b13eae433d4fb3e5/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.441700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9263a31d56554bb5b13eae433d4fb3e5, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.443097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.453417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 155/306] 10.222.0.25 () {58 vars in 1334 bytes} [Thu May 19 16:18:46 2022] PUT /identity/v3/system/users/9263a31d56554bb5b13eae433d4fb3e5/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:46.459819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.574124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf31d78-4062-410e-8a6a-421292e77d17 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.576677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.584652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89813fed-7998-46cf-9a95-5bed5a6ed632 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.618286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98120c26-7c8e-4a34-9f8e-cebc9f914011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.619104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120c26-7c8e-4a34-9f8e-cebc9f914011 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.619386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120c26-7c8e-4a34-9f8e-cebc9f914011 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.619693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120c26-7c8e-4a34-9f8e-cebc9f914011 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.620975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98120c26-7c8e-4a34-9f8e-cebc9f914011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.622460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98120c26-7c8e-4a34-9f8e-cebc9f914011 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.624184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 152/307] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:46.629510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7975c0-2e52-4ce6-85e4-ac357033fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.629611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4fece-3734-42c2-8545-f610689f2b4f None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.629684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7975c0-2e52-4ce6-85e4-ac357033fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.629778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4fece-3734-42c2-8545-f610689f2b4f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.629849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7975c0-2e52-4ce6-85e4-ac357033fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.629916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4fece-3734-42c2-8545-f610689f2b4f None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.629981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7975c0-2e52-4ce6-85e4-ac357033fbf9 None admin] PATH_INFO: `/v3/users/ebeec2ec2076404693e15e2d7b2c24a9` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.630047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 153/308] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:46.632844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4fece-3734-42c2-8545-f610689f2b4f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.648078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7975c0-2e52-4ce6-85e4-ac357033fbf9 None admin] RBAC: Authorizing `identity:get_user(user_id=ebeec2ec2076404693e15e2d7b2c24a9)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.649589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7975c0-2e52-4ce6-85e4-ac357033fbf9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.651339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 156/309] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:46 2022] GET /identity/v3/users/ebeec2ec2076404693e15e2d7b2c24a9 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:46.656916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.657209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.657494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.670555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.676346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:46.677542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:46.747309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 157/310] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:46.748103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.759735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4fece-3734-42c2-8545-f610689f2b4f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.808308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.809929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.810734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.811499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] PATH_INFO: `/v3/groups` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.812792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.814462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.843905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 154/311] 10.222.0.25 () {60 vars in 1134 bytes} [Thu May 19 16:18:46 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:46.845176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:46.862322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.884107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6795d5-c2fa-4555-9c6a-a32164e7d427 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:46.927525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:46.928573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:46.929027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:46.929439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:46.930432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] RBAC: Adding query filter params (role.id=0bab154d01a142039b70426c79b3fc0a, user.id=ebeec2ec2076404693e15e2d7b2c24a9, scope.system=all) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:46.930959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:46.932666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:46.938768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 158/312] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 19 16:18:46 2022] GET /identity/v3/role_assignments?user.id=ebeec2ec2076404693e15e2d7b2c24a9&scope.system=all&role.id=0bab154d01a142039b70426c79b3fc0a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:46.984651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:46.997654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a5e6-db8d-4054-bfb6-7e0021f2d7dc None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:47.040396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:47.041222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:47.041508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:47.041792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:47.055009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:47.065330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:47.066354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:47.067135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 155/313] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:47.074795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:47.199849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4353f-36c5-4919-b7e5-cee3411391b1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:47.237899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048f75-2290-4347-8537-b212a371f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:47.238599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048f75-2290-4347-8537-b212a371f031 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:47.238888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048f75-2290-4347-8537-b212a371f031 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:47.239166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048f75-2290-4347-8537-b212a371f031 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:47.239978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048f75-2290-4347-8537-b212a371f031 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:47.240288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048f75-2290-4347-8537-b212a371f031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:47.241677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048f75-2290-4347-8537-b212a371f031 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:47.250846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:47.255924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:47.372425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ef78f-4162-4457-8771-ce23df7fc4f3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:47.412537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:47.413424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:47.413710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:47.413989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] PATH_INFO: `/v3/users/74b8c954974e439f809c49c95d7e3ce0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:47.415223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] RBAC: Authorizing `identity:get_user(user_id=74b8c954974e439f809c49c95d7e3ce0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:47.416743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:47.418384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 156/315] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:47 2022] GET /identity/v3/users/74b8c954974e439f809c49c95d7e3ce0 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:47.424700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048f75-2290-4347-8537-b212a371f031 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:47.442206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:47.545573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048f75-2290-4347-8537-b212a371f031 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:47.582900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:47.583926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:47.584433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:47.585063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:47.658348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:47.660271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:47.677627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:47.765758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 160/316] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:47.771458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:47.795944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:47.884650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc801b-9201-4941-95d0-511e0489e805 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:47.921004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dbe0e-1083-4b15-a673-397dd10d4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:47.921942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbe0e-1083-4b15-a673-397dd10d4344 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:47.922229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbe0e-1083-4b15-a673-397dd10d4344 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:47.922504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbe0e-1083-4b15-a673-397dd10d4344 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:47.923724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dbe0e-1083-4b15-a673-397dd10d4344 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:47.925201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dbe0e-1083-4b15-a673-397dd10d4344 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:47.927941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 157/317] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:47 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:47.933276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:48.034916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4437aa-e4cb-4269-b9a9-0db5b0f58752 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:48.046099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:48.070921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:48.072187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:48.072469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:48.072742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:48.073575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] RBAC: Adding query filter params (role.id=0bab154d01a142039b70426c79b3fc0a, scope.project.id=76422a4580c642aba304d169fbc7cc5d, user.id=74b8c954974e439f809c49c95d7e3ce0) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:48.073886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:48.075338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b284-6058-492c-93a2-243844e37196 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:48.081764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 161/318] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:18:47 2022] GET /identity/v3/role_assignments?user.id=74b8c954974e439f809c49c95d7e3ce0&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=0bab154d01a142039b70426c79b3fc0a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:48.737924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6eb7-3ac4-4e33-92fc-e90a8f0a8ecd None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:48.738223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6eb7-3ac4-4e33-92fc-e90a8f0a8ecd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:48.738515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6eb7-3ac4-4e33-92fc-e90a8f0a8ecd None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:48.740041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 158/319] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:48.745072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:48.745533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:48.745615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:48.762597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:48.763808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:48.834556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 162/320] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:48.858157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6eb7-3ac4-4e33-92fc-e90a8f0a8ecd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:48.953852 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:48.970804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6eb7-3ac4-4e33-92fc-e90a8f0a8ecd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.005777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.006484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.006762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.007032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.018821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:49.027494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:49.028954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:49.029917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 159/321] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:49.036620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.138226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722724f-82a6-40e7-8bda-472709c57089 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.140985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:49.176701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.177371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.177649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.177975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.178718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:49.179072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.180515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52640-2413-4e08-9e04-e1157be2d642 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.188965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 163/322] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:49.194687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.207592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7ac7-ff04-48ef-a44d-965d97031092 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.207957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7ac7-ff04-48ef-a44d-965d97031092 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.208250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7ac7-ff04-48ef-a44d-965d97031092 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.209687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 164/323] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:49.214776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22689e6-f979-4400-b797-e31cc3a74f2c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.215067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22689e6-f979-4400-b797-e31cc3a74f2c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.215350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22689e6-f979-4400-b797-e31cc3a74f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.232117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a22689e6-f979-4400-b797-e31cc3a74f2c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:49.233315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a22689e6-f979-4400-b797-e31cc3a74f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:49.301810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 165/324] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:49.302123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffea82-2e6e-4b53-a23e-e22f31133d69 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.320878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24d9b-8ddb-4955-8794-60791e510007 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.321170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24d9b-8ddb-4955-8794-60791e510007 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.321457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24d9b-8ddb-4955-8794-60791e510007 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.322827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 166/325] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:49.324221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24d9b-8ddb-4955-8794-60791e510007 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.338796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf530f-76b1-460a-9d17-2315baeb49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.339701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf530f-76b1-460a-9d17-2315baeb49bc None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.339983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf530f-76b1-460a-9d17-2315baeb49bc None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.340262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf530f-76b1-460a-9d17-2315baeb49bc None admin] PATH_INFO: `/v3/users/9263a31d56554bb5b13eae433d4fb3e5` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.341461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf530f-76b1-460a-9d17-2315baeb49bc None admin] RBAC: Authorizing `identity:get_user(user_id=9263a31d56554bb5b13eae433d4fb3e5)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.342915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf530f-76b1-460a-9d17-2315baeb49bc None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.344604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 160/326] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/users/9263a31d56554bb5b13eae433d4fb3e5 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:49.344604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.344604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.344604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.362834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:49.364603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:49.373974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:49.418362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:49.425110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24d9b-8ddb-4955-8794-60791e510007 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.434422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 161/327] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:49.435283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.463352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.464253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.464525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.464800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.466080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.467539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.469210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 167/328] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:49.469985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.542397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3744d8-f2fb-481f-97e9-6708881e060f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.569780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d459-192d-4c3e-a34d-00d1c05dd145 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.577593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.578251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.578535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.578810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.579683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] RBAC: Adding query filter params (role.id=348cd2c2c2fb4a71b414a0af2fda86a6, user.id=9263a31d56554bb5b13eae433d4fb3e5, scope.system=all) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:49.580002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.581491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.593580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 162/329] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/role_assignments?user.id=9263a31d56554bb5b13eae433d4fb3e5&scope.system=all&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:49.594403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.597305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:49.604668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.605493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.605773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.606048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.619220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:49.627215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:49.628363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:49.629952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:49.634064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 168/330] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:49.635057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.663365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:49.725897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bba0b-821f-4de6-9136-e76372a90152 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.750074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338eac-ae1e-4e5d-aa01-c18b9fbb7ad6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.764756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.765424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.765708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.765986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] PATH_INFO: `/v3/groups` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.766690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.768227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.785751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 163/331] 10.222.0.25 () {60 vars in 1134 bytes} [Thu May 19 16:18:49 2022] POST /identity/v3/groups => generated 226 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:18:49.790473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.791170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.791467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.791757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.792525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:49.792841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.794275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.804878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 169/332] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:49.810889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:49.886203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:49.933425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c0ce-7fde-4adc-b8e0-698786b776db None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:49.968442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6f669-bfee-4fc9-bb4a-a6461a868471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:49.969319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f669-bfee-4fc9-bb4a-a6461a868471 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:49.969599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f669-bfee-4fc9-bb4a-a6461a868471 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:49.969877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f669-bfee-4fc9-bb4a-a6461a868471 None admin] PATH_INFO: `/v3/users/ebeec2ec2076404693e15e2d7b2c24a9` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:49.971094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6f669-bfee-4fc9-bb4a-a6461a868471 None admin] RBAC: Authorizing `identity:get_user(user_id=ebeec2ec2076404693e15e2d7b2c24a9)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:49.973156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6f669-bfee-4fc9-bb4a-a6461a868471 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:49.974822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 164/333] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:49 2022] GET /identity/v3/users/ebeec2ec2076404693e15e2d7b2c24a9 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:49.980467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:50.072138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:50.090795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9dee-f205-4319-881c-4c08cb0c19a1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:50.127075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767ec0-5dfd-4af1-90e2-ff35b61c0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:50.127985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767ec0-5dfd-4af1-90e2-ff35b61c0183 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:50.128269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767ec0-5dfd-4af1-90e2-ff35b61c0183 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:50.128583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767ec0-5dfd-4af1-90e2-ff35b61c0183 None admin] PATH_INFO: `/v3/system/users/ebeec2ec2076404693e15e2d7b2c24a9/roles/0bab154d01a142039b70426c79b3fc0a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:50.130107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9767ec0-5dfd-4af1-90e2-ff35b61c0183 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ebeec2ec2076404693e15e2d7b2c24a9, role_id=0bab154d01a142039b70426c79b3fc0a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:50.131528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9767ec0-5dfd-4af1-90e2-ff35b61c0183 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:50.142720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 170/334] 10.222.0.25 () {58 vars in 1334 bytes} [Thu May 19 16:18:49 2022] PUT /identity/v3/system/users/ebeec2ec2076404693e15e2d7b2c24a9/roles/0bab154d01a142039b70426c79b3fc0a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:52.544451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b427-c719-483c-87f2-0027769a8743 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:52.545005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b427-c719-483c-87f2-0027769a8743 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:52.545005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b427-c719-483c-87f2-0027769a8743 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:52.546718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 165/335] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:52.553518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcbaa3-2689-4513-8c0b-8511450df3a5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:52.554030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcbaa3-2689-4513-8c0b-8511450df3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:52.554103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcbaa3-2689-4513-8c0b-8511450df3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:52.575657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-25bcbaa3-2689-4513-8c0b-8511450df3a5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:52.576900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-25bcbaa3-2689-4513-8c0b-8511450df3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:52.674519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 171/336] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:52.712279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b427-c719-483c-87f2-0027769a8743 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:52.795178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5211da-228d-4ef3-8b6a-2726f16a4ade None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:52.795361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5211da-228d-4ef3-8b6a-2726f16a4ade None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:52.795655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5211da-228d-4ef3-8b6a-2726f16a4ade None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:52.797050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 172/337] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:52.803380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338f38-71b6-4846-8108-35fe880622ee None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:52.804034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338f38-71b6-4846-8108-35fe880622ee None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:52.804611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338f38-71b6-4846-8108-35fe880622ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:52.825336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-62338f38-71b6-4846-8108-35fe880622ee None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:52.827671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-62338f38-71b6-4846-8108-35fe880622ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:52.872505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b427-c719-483c-87f2-0027769a8743 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:52.943684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:52.961733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 173/338] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:52.963837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:52.964648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:52.964932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:52.965205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:52.992891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:53.005201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:53.006166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:53.006976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 166/339] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:53.008347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338f38-71b6-4846-8108-35fe880622ee None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.013519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.039122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:53.212613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d0dd-7893-44f1-a64a-461c2ab6a9b9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.230268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338f38-71b6-4846-8108-35fe880622ee None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.276770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:53.278037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.278781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.279258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.280441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:53.281101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:53.282958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182b8bb-7f11-4a95-8cee-1160a73bde34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:53.283325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93be121-ca8e-46ea-a74d-f790facb9e5d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:53.283800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182b8bb-7f11-4a95-8cee-1160a73bde34 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.284081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182b8bb-7f11-4a95-8cee-1160a73bde34 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.284355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182b8bb-7f11-4a95-8cee-1160a73bde34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.295053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 167/340] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:53.296746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ba0f-393a-4efe-948a-b0419d061c6d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.297410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ba0f-393a-4efe-948a-b0419d061c6d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.297911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ba0f-393a-4efe-948a-b0419d061c6d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.299418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 168/341] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:53.303668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182b8bb-7f11-4a95-8cee-1160a73bde34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:53.304960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ba0f-393a-4efe-948a-b0419d061c6d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-e182b8bb-7f11-4a95-8cee-1160a73bde34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:53.317288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:53.318237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 16:18:53.319020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:53.323762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 174/342] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:53.325890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.326674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.326794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.352108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:53.353167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:53.372510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:53.428480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:53.431318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ba0f-393a-4efe-948a-b0419d061c6d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.433658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 175/343] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:53.435246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.471811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:53.473540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.474041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.474603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.547651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f57c2-6c89-4488-a40f-6ff751e704ad None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.553405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:53.555675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:53.591421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:53.592183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.592427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.592922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.593603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:53.593911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:53.595479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359460d8-1d3f-4600-8066-3f7ff82e7d8b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:53.605355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 176/344] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:53.610991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c974255-8c74-4c26-a2b8-b18ee4d4e965 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.611280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c974255-8c74-4c26-a2b8-b18ee4d4e965 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.611561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c974255-8c74-4c26-a2b8-b18ee4d4e965 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.613097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 177/345] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:53.613923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c974255-8c74-4c26-a2b8-b18ee4d4e965 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.629342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:53.688000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 169/346] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:53.689031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.689614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:53.736186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c974255-8c74-4c26-a2b8-b18ee4d4e965 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.779325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388103fb-c449-40cd-a4e2-c764295038ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:53.781221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388103fb-c449-40cd-a4e2-c764295038ce None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.781701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388103fb-c449-40cd-a4e2-c764295038ce None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.782216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388103fb-c449-40cd-a4e2-c764295038ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.794105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388103fb-c449-40cd-a4e2-c764295038ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-388103fb-c449-40cd-a4e2-c764295038ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:53.802414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:53.803346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:53.804212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:53.806702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 178/347] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:53.808315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.808805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.809271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.810895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e986bb-3863-47cd-a32f-3cd4324664cd None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.829186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:53.830723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:53.852524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:53.853063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:53.853355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:53.853634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] PATH_INFO: `/v3/users/ebeec2ec2076404693e15e2d7b2c24a9` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:53.854913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] RBAC: Authorizing `identity:get_user(user_id=ebeec2ec2076404693e15e2d7b2c24a9)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:53.856541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:53.858264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 170/348] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/users/ebeec2ec2076404693e15e2d7b2c24a9 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:53.859076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.896236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:53.937072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 179/349] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:53.938372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:53.984476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f4ca6-7999-405f-85ca-9f0f4475493a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:53.998655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.028913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.030134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.030567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.031016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.032559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.034296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.036519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 171/350] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:54.037531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.057452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646611a3-c8e7-4261-b7c0-2a6c8313e604 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.094964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.095756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.096098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.096375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.097222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:54.097532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.099300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.108334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 180/351] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:54.109355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.140026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.152926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39404774-f881-4b0a-892d-b9421207c6de None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.195508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.196361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.196781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.197161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.198153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] RBAC: Adding query filter params (role.id=0bab154d01a142039b70426c79b3fc0a, user.id=ebeec2ec2076404693e15e2d7b2c24a9, scope.system=all) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:54.198578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.200269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.215398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 172/352] 10.222.0.25 () {56 vars in 1308 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/role_assignments?user.id=ebeec2ec2076404693e15e2d7b2c24a9&scope.system=all&role.id=0bab154d01a142039b70426c79b3fc0a => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:54.216555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.237660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf38367-43b3-4383-9048-5bc15406c0a7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.262384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.302233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.303128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.303416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.303726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.316595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:54.326192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:54.327155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:54.327965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:54.333158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 181/353] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:54.333158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.407553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223d68-2af7-4d3f-9db8-21a454033125 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.488424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.489317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.489597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.489870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.503081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.504704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.506510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 173/354] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:54.513053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e1ac5-0f8f-4462-8464-72e4ae82e0c9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.514948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.537423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.565949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2a33d-a79c-48cb-863c-255f4dfdc8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.567731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a33d-a79c-48cb-863c-255f4dfdc8fd None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.568222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a33d-a79c-48cb-863c-255f4dfdc8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.568696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a33d-a79c-48cb-863c-255f4dfdc8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.620232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.648190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2a33d-a79c-48cb-863c-255f4dfdc8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.649677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2a33d-a79c-48cb-863c-255f4dfdc8fd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.666673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b002d-9ba5-4bb1-923f-a92722c261d8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.731209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.731978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.732266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.732602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.733380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:54.733712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.735207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.745907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 174/355] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:54.746584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.786383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 182/356] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:54.787697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090f147-a278-489a-87b9-8aff205500c4 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.787988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090f147-a278-489a-87b9-8aff205500c4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.788266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090f147-a278-489a-87b9-8aff205500c4 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.789853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 183/357] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:54.790579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090f147-a278-489a-87b9-8aff205500c4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:54.838513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.875199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a786-3138-4059-b43e-d0e72d925afe None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.895502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:54.932983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:54.934101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:54.934502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090f147-a278-489a-87b9-8aff205500c4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:54.934705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:54.935123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:54.936175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=2e3ab599465546119d3df661adb91307) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:54.937642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:54.939127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:54.953183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 175/358] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:54.953961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.004069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fc727-b48d-4a03-be12-d9680f45edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.004985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fc727-b48d-4a03-be12-d9680f45edeb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.005430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fc727-b48d-4a03-be12-d9680f45edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.005848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fc727-b48d-4a03-be12-d9680f45edeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.100254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ede874-427b-4251-b195-5c279cf9e546 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.100972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fc727-b48d-4a03-be12-d9680f45edeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:55.102486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fc727-b48d-4a03-be12-d9680f45edeb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:55.146752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded157-22f0-48a5-ad8e-1bfbf3701fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.148022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded157-22f0-48a5-ad8e-1bfbf3701fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.148557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded157-22f0-48a5-ad8e-1bfbf3701fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.148731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded157-22f0-48a5-ad8e-1bfbf3701fe8 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.150197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ded157-22f0-48a5-ad8e-1bfbf3701fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:55.151757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ded157-22f0-48a5-ad8e-1bfbf3701fe8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:55.153844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 176/359] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:55.155121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.155428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.155734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.163418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:55.180310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:55.181548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:55.216011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:55.249245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 184/360] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:55.250925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74d6c9-80fb-4938-9ad9-963fa1514564 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.251215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74d6c9-80fb-4938-9ad9-963fa1514564 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.251496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74d6c9-80fb-4938-9ad9-963fa1514564 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.253175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 185/361] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:55.254539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74d6c9-80fb-4938-9ad9-963fa1514564 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.279486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 177/362] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:55.281082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.394506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74d6c9-80fb-4938-9ad9-963fa1514564 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.410414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479704f-2209-4611-a7d1-dd247d89dedb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.448294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b274b-a947-4677-9ebf-8600a96f65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.449272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b274b-a947-4677-9ebf-8600a96f65a9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.449553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b274b-a947-4677-9ebf-8600a96f65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.449828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b274b-a947-4677-9ebf-8600a96f65a9 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.451177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b274b-a947-4677-9ebf-8600a96f65a9 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:55.452742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b274b-a947-4677-9ebf-8600a96f65a9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:55.454836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 186/363] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:55.461095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.461384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.461663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.463647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.464627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.464907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.465174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.466365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:55.471210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:55.471210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 178/364] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:55.471210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.477091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:55.480797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:55.482022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:55.522071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:55.559922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 187/365] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:55.560792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.609214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f71987-9848-4abf-8c15-304fd16396e9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.662694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.662694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.662694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.662694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.676792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:55.685505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:55.686448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:55.687236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 179/366] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:55.687989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.710276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac29f6e-a6f4-4c6e-a32d-7fae883b3405 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.758833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.759707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.759933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.760213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.761065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=76422a4580c642aba304d169fbc7cc5d) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:55.761381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:55.762984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:55.771411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 188/367] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:55.772183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.776148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:55.824059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:55.832597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b38f-141d-4c45-acd1-a1dc364d431a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.878135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.879708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.880017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.880294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.881738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:55.883252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:55.886489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 180/368] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:55.887493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:55.903068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1bef8-1e4e-4375-b9cf-fa62d27fc7f1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:55.950196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:55.952348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:55.952348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:55.952348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:55.966846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:55.976355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:55.977348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:18:55.978143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 189/369] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:55.979299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:56.037525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708604-f0f4-46ae-a2c2-45637328ed20 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:56.080238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:56.088830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:56.089863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:56.090349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:56.090843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:56.092002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:56.092559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:56.094200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:56.104714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 181/370] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:56.110631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:56.112101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:56.118502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1e8b-d649-4d70-8140-26659e9895d3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:56.159453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:56.160186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:56.160474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:56.160756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:56.161702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=2e3ab599465546119d3df661adb91307) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:56.162020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:56.163555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:56.170040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 190/371] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:18:55 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:56.171031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:56.245180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197d90-6086-4af2-b077-83ba939d1b56 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:56.298703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64996a-10b1-4f13-9ec4-844d19a16536 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:56.302770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:56.303918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:56.304447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:56.305000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:56.307822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:56.308668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:56.310817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:56.324400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 182/372] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:56.332816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:56.364322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:56.365225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:56.365500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:56.365788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:56.443014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:56.478882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:56.501570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:56.503037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:56.592002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2e80-b9e8-42cf-9bf0-3725fe36f040 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:56.648337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 191/373] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:56.651383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:56.652098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:56.652383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:56.652671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:56.654187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:56.776487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:56.802824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:56.804358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:56.845756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee527-f9ba-4bc8-ba73-eaa0a3af4761 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:56.925677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:56.941668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:56.942554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:56.942840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:56.943116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:56.945959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:56.947520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:56.949557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 192/374] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:56 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:56.957262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:57.016850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 183/375] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:18:57.024678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:57.114943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90d49-7c01-4485-8f17-b9691692315c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:57.144643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:57.154307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:57.154584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.159638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.159638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.159638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:57.159638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:57.164011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 193/376] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:18:56 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:57.166008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:57.203465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54598fe-56d6-41b3-90dc-938ddbb032f0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:57.262361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:57.263575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.264061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.264580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] PATH_INFO: `/v3/projects/728349d622174859ba2f65ffafdfe844` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.268923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] RBAC: Authorizing `identity:get_project(project_id=728349d622174859ba2f65ffafdfe844)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:57.270678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:57.273265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 184/377] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:57 2022] GET /identity/v3/projects/728349d622174859ba2f65ffafdfe844 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:57.282420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27731-c942-4d55-ad2f-3e0b70f2bfd6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:57.295843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:57.321520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:57.322412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.322521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.322739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.323584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=76422a4580c642aba304d169fbc7cc5d) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:57.324102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:57.325581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:57.332506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 194/378] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:18:57 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:57.345928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:57.460727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ec46-1a59-4e97-97c5-33bd79ebfd5b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:57.503467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade25e86-c152-4e4c-af46-96ae3d614280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:57.504460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25e86-c152-4e4c-af46-96ae3d614280 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.504745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25e86-c152-4e4c-af46-96ae3d614280 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.505021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25e86-c152-4e4c-af46-96ae3d614280 None admin] PATH_INFO: `/v3/groups/1e449890d00e4d4797b8656f0f47502d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.510989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade25e86-c152-4e4c-af46-96ae3d614280 None admin] RBAC: Authorizing `identity:get_group(group_id=1e449890d00e4d4797b8656f0f47502d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:57.512549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade25e86-c152-4e4c-af46-96ae3d614280 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:57.514663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 185/379] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:18:57 2022] GET /identity/v3/groups/1e449890d00e4d4797b8656f0f47502d => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:57.520311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:57.611002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:57.628347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffe600-1a67-4aea-b5fe-66edb218ae46 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.628999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffe600-1a67-4aea-b5fe-66edb218ae46 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.629493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffe600-1a67-4aea-b5fe-66edb218ae46 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.631267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 186/380] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:57.638894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303527-610f-49d9-8da5-83448398c31e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.639513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303527-610f-49d9-8da5-83448398c31e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.640016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303527-610f-49d9-8da5-83448398c31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.674934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-04303527-610f-49d9-8da5-83448398c31e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:57.676604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-04303527-610f-49d9-8da5-83448398c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:57.685670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b533ad-8339-438a-ad98-0e7af6d5db18 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:57.745256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:57.745847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.746133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.746413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.747377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] RBAC: Adding query filter params (group.id=1e449890d00e4d4797b8656f0f47502d, role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=728349d622174859ba2f65ffafdfe844) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:57.748073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:57.749360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:57.761457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 187/381] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:18:57.761806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 195/382] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:18:57 2022] GET /identity/v3/role_assignments?group.id=1e449890d00e4d4797b8656f0f47502d&scope.project.id=728349d622174859ba2f65ffafdfe844&role.id=627731b88fe44de39e8e182a119e4c00 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:57.786444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303527-610f-49d9-8da5-83448398c31e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:57.807902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:57.916072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303527-610f-49d9-8da5-83448398c31e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:57.953548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:57.954352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:57.954631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:57.954904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:57.966826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:57.975439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:57.976419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:57.977255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 188/383] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:18:57.984870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:58.129211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c7779-3549-46ce-bf61-2e07986903e7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:58.155583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:58.169947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:58.170629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:58.170917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:58.171197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:58.172003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:18:58.172313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:58.173707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:58.187578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 196/384] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:18:58.193878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:58.308155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:58.349240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b79fce-99ca-41c7-b143-f81f13ec2318 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:58.394000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:58.394792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:58.395075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:58.395349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:58.400378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:58.401912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:58.404373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 189/385] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:18:58 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:58.409799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:58.535756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764294f-635f-4301-a19c-33bfe960a994 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:58.582576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926a072-762c-4c42-b5a1-2eab791f5541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:58.583852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a072-762c-4c42-b5a1-2eab791f5541 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:58.584363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a072-762c-4c42-b5a1-2eab791f5541 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:58.584860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a072-762c-4c42-b5a1-2eab791f5541 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:58.586346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926a072-762c-4c42-b5a1-2eab791f5541 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:58.588054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926a072-762c-4c42-b5a1-2eab791f5541 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:58.590353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 197/386] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:18:58 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:18:58.596377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:58.742938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ac33-9126-4f66-8989-6363a3ee1823 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:58.814436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6499-3370-44e4-a0bf-dcf661d5a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:58.815341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6499-3370-44e4-a0bf-dcf661d5a881 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:58.815681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6499-3370-44e4-a0bf-dcf661d5a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:58.816160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6499-3370-44e4-a0bf-dcf661d5a881 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:58.818183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6499-3370-44e4-a0bf-dcf661d5a881 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3ab599465546119d3df661adb91307, group_id=4b927e18c5a54882a9fa2848acc29d1a, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:18:58.819653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6499-3370-44e4-a0bf-dcf661d5a881 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:18:58.839925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 190/387] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 19 16:18:58 2022] PUT /identity/v3/projects/2e3ab599465546119d3df661adb91307/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:18:59.359807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3f15c-5066-4515-b9ad-e3dbb73de22e None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:59.360765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3f15c-5066-4515-b9ad-e3dbb73de22e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:59.361053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3f15c-5066-4515-b9ad-e3dbb73de22e None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:59.362629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 198/388] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:18:59.368621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:59.368910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:59.369190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:59.376581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:59.388453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:59.396419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:59.458933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8227af-84a3-4a6a-a5b6-1fd8d4eae42d None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:59.459239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8227af-84a3-4a6a-a5b6-1fd8d4eae42d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:59.459497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8227af-84a3-4a6a-a5b6-1fd8d4eae42d None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:59.461213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 199/389] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:18:59.482630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:59.483031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:59.483378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:59.495683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 191/390] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:59.508483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:18:59.509933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:18:59.536957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:59.579983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:59.646529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 200/391] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:18:59.710451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5e062-fead-4a3e-bd3f-ca9d63f769dc None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:18:59.728074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:59.760186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:18:59.761004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:18:59.761283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:18:59.761562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:18:59.763993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:18:59.796631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:18:59.805170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:18:59.806104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:18:59.806920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 192/392] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:18:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:18:59.816169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:18:59.926029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983313f5-7ace-423e-92e5-59c8675f1a8b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.003075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07d16-8c34-45b2-8972-f17fa2672150 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.030091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.031272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.031809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.032284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.053772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.054848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.055337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.056316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.057112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:00.058132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:00.062208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.063987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:00.071197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:00.072178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:00.072973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:00.079461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 201/393] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:18:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:00.084909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 193/394] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:18:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:00.086168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.091337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.188806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:00.195014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:00.247401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dade50-5925-44f6-963d-6121a18786d8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.262901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395e586-5bfc-4202-8aa0-f19bfa1ef821 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.301425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06153c-a2cc-4609-aaa4-620d5e11d9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.302726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06153c-a2cc-4609-aaa4-620d5e11d9ce None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.303116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06153c-a2cc-4609-aaa4-620d5e11d9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.303516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06153c-a2cc-4609-aaa4-620d5e11d9ce None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.305750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06153c-a2cc-4609-aaa4-620d5e11d9ce None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.307715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06153c-a2cc-4609-aaa4-620d5e11d9ce None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.309820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 194/395] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:00.311894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5bedd-837a-4d80-9ec1-b9c90de29088 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.312479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5bedd-837a-4d80-9ec1-b9c90de29088 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.313075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5bedd-837a-4d80-9ec1-b9c90de29088 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.316224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 195/396] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:00.317164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5bedd-837a-4d80-9ec1-b9c90de29088 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.322028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.323106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.323398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.323726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.325626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:00.325949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.327386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9c709-0037-4e02-8a99-5112ce12fc10 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.337973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 202/397] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:00.344637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.344940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.345213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.362905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:00.364359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:00.448252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 203/398] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:00.449199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.452400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5bedd-837a-4d80-9ec1-b9c90de29088 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.480598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:00.496714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.497599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.497885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.498201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.499485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.501345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.504633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 196/399] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:00.505631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.509370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:00.584504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bba838-078d-4a98-a744-b9c258f3301c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.618108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aaec1-1684-4716-96c0-9f0d7754e76d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.619980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.621113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.621113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.621405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.622608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.624121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.630948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 204/400] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:00.630948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.661111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e2394-2f4c-4f59-ba45-5ca081445c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.662047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2394-2f4c-4f59-ba45-5ca081445c07 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.662350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2394-2f4c-4f59-ba45-5ca081445c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.662615 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2394-2f4c-4f59-ba45-5ca081445c07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.673379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e2394-2f4c-4f59-ba45-5ca081445c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b74e2394-2f4c-4f59-ba45-5ca081445c07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:00.682165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:00.683064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:00.684414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 197/401] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:00.685106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d12a-568b-479f-912d-41d83437fd2a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.685106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d12a-568b-479f-912d-41d83437fd2a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.685235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d12a-568b-479f-912d-41d83437fd2a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.691547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 198/402] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:00.691547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d12a-568b-479f-912d-41d83437fd2a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.747181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78a242-86b0-45fb-83e1-5d1a1e58dbea None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.749249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:00.751126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:00.788770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.789821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.790104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.790377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.792343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] RBAC: Authorizing `identity:create_grant(project_id=76422a4580c642aba304d169fbc7cc5d, group_id=4b927e18c5a54882a9fa2848acc29d1a, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.794027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.804356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d12a-568b-479f-912d-41d83437fd2a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.816324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 205/403] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 19 16:19:00 2022] PUT /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:00.816324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:00.853973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e750-fc57-47ff-a7e4-99b33c555cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:00.854910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e750-fc57-47ff-a7e4-99b33c555cab None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.855243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e750-fc57-47ff-a7e4-99b33c555cab None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.855850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e750-fc57-47ff-a7e4-99b33c555cab None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.858332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e750-fc57-47ff-a7e4-99b33c555cab None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:00.859990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e750-fc57-47ff-a7e4-99b33c555cab None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:00.863789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 199/404] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:00.865129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:00.865417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:00.865696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:00.891776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:00.893066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:00.957452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070e0df-33ae-41c5-aa17-4f03ccd6eea8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:00.988508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 200/405] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:00.989588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.008194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.009270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.009787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.010258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.013796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:01.014136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.015676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.029909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 206/406] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:01.030818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.085351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:01.085614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:01.143778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2d89b-a0cd-49e9-8f67-4a26ce2dd517 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.161050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfc802-7c62-47de-8889-008dc1b7e97f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.191577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.192758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.193457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.193733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.197063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3ab599465546119d3df661adb91307, group_id=4b927e18c5a54882a9fa2848acc29d1a, role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.199457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.204827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.205999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.207317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.207317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.220672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:01.221080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 201/407] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 19 16:19:00 2022] PUT /identity/v3/projects/2e3ab599465546119d3df661adb91307/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:01.227647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:01.230295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:01.231369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:01.232527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:01.234553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 207/408] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:01.241188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.455707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:01.477945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170b76-9966-430b-9c4f-3912286adc6f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.479002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4306a-f4fc-46d7-a85c-adc45e36ca29 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.494450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:01.528770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.529449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.529736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.530013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.530775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:01.531087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.532085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.532549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.533268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.533685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.534944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.536859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.538566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.545687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 202/409] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:01.547401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.553072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 208/410] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:01.560322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.703670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b7840-fc7d-41d1-b31c-a93477563e9c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.722368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b33bf-d9ef-41e5-8e2d-9991dfb76308 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.743244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683046e-44e1-40f7-b617-5536d44bb7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.744253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683046e-44e1-40f7-b617-5536d44bb7ed None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.744536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683046e-44e1-40f7-b617-5536d44bb7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.744809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683046e-44e1-40f7-b617-5536d44bb7ed None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.746143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683046e-44e1-40f7-b617-5536d44bb7ed None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.747604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683046e-44e1-40f7-b617-5536d44bb7ed None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.749492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 203/411] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:01.750769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b428c-48e8-4bba-bc4c-25fd569c97f4 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.751162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b428c-48e8-4bba-bc4c-25fd569c97f4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.751437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b428c-48e8-4bba-bc4c-25fd569c97f4 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.753144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 204/412] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:01.757557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b428c-48e8-4bba-bc4c-25fd569c97f4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.777957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5241b-8092-4ad4-94e2-da75b556a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.779112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5241b-8092-4ad4-94e2-da75b556a350 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.779546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5241b-8092-4ad4-94e2-da75b556a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.779884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5241b-8092-4ad4-94e2-da75b556a350 None admin] PATH_INFO: `/v3/groups/1e449890d00e4d4797b8656f0f47502d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.781496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5241b-8092-4ad4-94e2-da75b556a350 None admin] RBAC: Authorizing `identity:get_group(group_id=1e449890d00e4d4797b8656f0f47502d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.782977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5241b-8092-4ad4-94e2-da75b556a350 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.788790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 209/413] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/groups/1e449890d00e4d4797b8656f0f47502d => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:01.790406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.791065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.791701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.810341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:01.811898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:01.825382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:01.827185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:01.891705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b428c-48e8-4bba-bc4c-25fd569c97f4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:01.912101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 210/414] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:01.913185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:01.931159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:01.932433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:01.932909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:01.933370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:01.936004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=76422a4580c642aba304d169fbc7cc5d, group_id=4b927e18c5a54882a9fa2848acc29d1a, role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:01.937698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:01.958135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 205/415] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 19 16:19:01 2022] PUT /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d/groups/4b927e18c5a54882a9fa2848acc29d1a/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:01.959538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:02.050157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280d863-d787-44ba-a9d2-618b57cff6ad None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:02.088388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:02.089611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:02.089899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:02.090178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] PATH_INFO: `/v3/projects/728349d622174859ba2f65ffafdfe844` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:02.091504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] RBAC: Authorizing `identity:get_project(project_id=728349d622174859ba2f65ffafdfe844)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:02.093814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:02.095799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 211/416] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/projects/728349d622174859ba2f65ffafdfe844 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:02.101727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:02.123171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:02.172830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b76ea8-3a93-4c77-a599-8c79f07a74d8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:02.190331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:02.223783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ccfd-3b0b-42bd-b625-498ec81788ab None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:02.242088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:02.243248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:02.243892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:02.244365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:02.260566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:02.264273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:02.265177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:02.265463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:02.265742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] PATH_INFO: `/v3/projects/728349d622174859ba2f65ffafdfe844/groups/1e449890d00e4d4797b8656f0f47502d/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:02.267786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] RBAC: Authorizing `identity:create_grant(project_id=728349d622174859ba2f65ffafdfe844, group_id=1e449890d00e4d4797b8656f0f47502d, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:02.269300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:02.271162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:02.272155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:19:02.273134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:02.276018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 206/417] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:02.282252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:02.289658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 212/418] 10.222.0.25 () {58 vars in 1442 bytes} [Thu May 19 16:19:02 2022] PUT /identity/v3/projects/728349d622174859ba2f65ffafdfe844/groups/1e449890d00e4d4797b8656f0f47502d/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:02.410887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc96a9-d6f5-44cc-a7b9-fd34858f5881 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:02.451820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:02.452875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:02.453354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:02.453938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:02.454905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] RBAC: Adding query filter params (name=member) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:02.455453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:02.457190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:02.467643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 207/419] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:02.475535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:02.577338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:02.608942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3c0b-16de-40e1-b50e-eed5a729ff28 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:02.646577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:02.647242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:02.647529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:02.647838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:02.772885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:02.774626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:02.859611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:02.887978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 213/420] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:02.894306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:02.944025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:03.060621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342448e7-636c-4657-86d9-e5f6ac8a740a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:03.121353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:03.122617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.123105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.123584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.125098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:03.126838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:03.129248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 208/421] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:02 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:03.135003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:03.304613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4883a-3228-41f4-b4c4-07a77a501c59 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:03.352575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6970233-f696-41a8-aebb-115c277a639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:03.353366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6970233-f696-41a8-aebb-115c277a639f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.353652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6970233-f696-41a8-aebb-115c277a639f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.353932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6970233-f696-41a8-aebb-115c277a639f None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.356374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6970233-f696-41a8-aebb-115c277a639f None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:03.357860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6970233-f696-41a8-aebb-115c277a639f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:03.359842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 214/422] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:03 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:03.365667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:03.552889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:03.560934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5530c-9a00-4b4a-9eea-c6fc92225c59 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:03.610303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:03.611386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.611905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.612932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.613977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=2e3ab599465546119d3df661adb91307) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:03.614494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:03.616234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e60bfa-e895-48ac-afae-c3f2db91e98e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:03.629180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 209/423] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:19:03 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 611 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:03.637177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11c44-6c45-476b-8aab-80f6949f1d57 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.637690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11c44-6c45-476b-8aab-80f6949f1d57 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.637791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11c44-6c45-476b-8aab-80f6949f1d57 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.639424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 215/424] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:03.657732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192690-805a-4aaf-bc53-4e2bfb286c6f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.658050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192690-805a-4aaf-bc53-4e2bfb286c6f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.658290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192690-805a-4aaf-bc53-4e2bfb286c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.688952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ba192690-805a-4aaf-bc53-4e2bfb286c6f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:03.690216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ba192690-805a-4aaf-bc53-4e2bfb286c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:03.781175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 210/425] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:03.825202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11c44-6c45-476b-8aab-80f6949f1d57 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:03.893590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:03.935729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae164d-8712-4ef1-9500-533d25f2b502 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.936303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae164d-8712-4ef1-9500-533d25f2b502 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.936303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae164d-8712-4ef1-9500-533d25f2b502 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.937995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 211/426] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:19:03.944456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:03.944752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:03.945015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:03.966597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:03.968078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:03.969715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11c44-6c45-476b-8aab-80f6949f1d57 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.013915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.014995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.015463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.015938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.031647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:04.041678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:04.042654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 16:19:04.043483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:04.045950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 216/427] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:04.053722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.071000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 212/428] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:04.096642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.138466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:04.204485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45b50-d721-48c7-9250-5543b9947d89 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.206493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:04.249046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.249880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.250283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.250630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.251452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:04.251853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:04.253350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:04.253997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd1896-68eb-47cd-988a-26d54ebf7318 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.264028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 217/429] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:04.269440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.304415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.305791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.306680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.307403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.322257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:04.334034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:04.334991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:04.335839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:04.337537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 213/430] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:04.343113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.390597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c29b-4283-41c8-8c5d-3680159e6dd6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.437053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.437719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.438001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.438278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.456944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:04.476505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:04.490396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19df7-84de-4cd8-94a6-54ee346e62ba None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.525011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:04.526487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:04.541304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.543062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.543557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.544083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.545796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:04.546336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:04.548609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:04.562209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 214/431] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:04.568279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.658786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 218/432] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:19:04.665576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.705820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915e2c-479f-41bc-bbe7-7d8e03a6b0c0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.753092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e868a8-bc93-47d3-a3d7-42046169f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.753649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e868a8-bc93-47d3-a3d7-42046169f854 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.753931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e868a8-bc93-47d3-a3d7-42046169f854 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.754211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e868a8-bc93-47d3-a3d7-42046169f854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.762852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:04.771759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:04.832656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055b87-0f6f-4a47-8866-2a159e2f18ee None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:04.845167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e868a8-bc93-47d3-a3d7-42046169f854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:04.847154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e868a8-bc93-47d3-a3d7-42046169f854 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:04.872274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:04.873607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.874095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.874570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.876122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:04.877920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:04.884860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 219/433] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:04.886034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:04.958973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 215/434] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:19:04.960555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4908e6-389e-4ad8-b771-0af3475e89fb None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:04.960841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4908e6-389e-4ad8-b771-0af3475e89fb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:04.961116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4908e6-389e-4ad8-b771-0af3475e89fb None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:04.966757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 216/435] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:04.966757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4908e6-389e-4ad8-b771-0af3475e89fb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.006854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2bbf-5405-48cd-b2eb-d3dbcc924fc2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.020353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.041104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.047077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be716d4-40ee-472f-8646-748c49a9ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.047970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be716d4-40ee-472f-8646-748c49a9ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.048253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be716d4-40ee-472f-8646-748c49a9ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.048527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be716d4-40ee-472f-8646-748c49a9ecfd None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.049731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be716d4-40ee-472f-8646-748c49a9ecfd None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.052438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be716d4-40ee-472f-8646-748c49a9ecfd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.059776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 220/436] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:05.059776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.059776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.059776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.074437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:05.075648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:05.091567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4908e6-389e-4ad8-b771-0af3475e89fb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.139903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.140782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.141069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.141343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] PATH_INFO: `/v3/projects/2e3ab599465546119d3df661adb91307` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.142602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] RBAC: Authorizing `identity:get_project(project_id=2e3ab599465546119d3df661adb91307)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.144761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.146697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 217/437] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:04 2022] GET /identity/v3/projects/2e3ab599465546119d3df661adb91307 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:05.147298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.158558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 221/438] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:05.159460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.255177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5442e6e-6665-4587-939f-b7b924c2bdae None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.259262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320492a6-c85e-4ac3-8fe2-3528fc797ebe None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.265935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.292218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.292879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.293161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.293438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.294274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=348cd2c2c2fb4a71b414a0af2fda86a6, scope.project.id=76422a4580c642aba304d169fbc7cc5d) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:05.294588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.305016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fd42d-e7b9-420f-b7c6-e3a6fc5be9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.305230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5e25f-cc61-4353-816d-01b5035b2a1e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.305313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.305313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd42d-e7b9-420f-b7c6-e3a6fc5be9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.305313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd42d-e7b9-420f-b7c6-e3a6fc5be9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.305313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd42d-e7b9-420f-b7c6-e3a6fc5be9f4 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.305563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 218/439] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=348cd2c2c2fb4a71b414a0af2fda86a6 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:05.305563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610291f-1880-4869-96a5-e88dd60087e0 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.305563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610291f-1880-4869-96a5-e88dd60087e0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.305563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610291f-1880-4869-96a5-e88dd60087e0 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.305563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 219/440] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:05.305837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fd42d-e7b9-420f-b7c6-e3a6fc5be9f4 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.305912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610291f-1880-4869-96a5-e88dd60087e0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.307474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fd42d-e7b9-420f-b7c6-e3a6fc5be9f4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.316090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:05.316090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.316090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.316090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.338516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:05.340137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:05.420056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 223/442] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:05.420842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.438973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610291f-1880-4869-96a5-e88dd60087e0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.481508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.482673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.483097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.483382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.495507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:05.504469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:05.505454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:05.506401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 220/443] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:05.507187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.543070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9593e-dbdc-458b-96d9-d79cce310ebd None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.552049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.574597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.585761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.586456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.586855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.587132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.588041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=2e3ab599465546119d3df661adb91307) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:05.588333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.589795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.595909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 224/444] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=2e3ab599465546119d3df661adb91307&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:05.596746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.632618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b3c9-d74d-4609-ae51-8ab5f96665eb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.678433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.679248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.679544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.679851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.692402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:05.700371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:05.701402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:05.702215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 221/445] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:05.708112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.723596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e84ce5-c5aa-42ee-bb84-971a1fa141d8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.764016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.764885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.765179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.765458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.766237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:05.766551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.767994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.777655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 225/446] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:05.783492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.826666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.837072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdfed3-7393-457c-826e-84815d769a9a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.863732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:05.882488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.883161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.883442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.883779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:05.884542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:05.884850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:05.886273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:05.898839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 222/447] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:05.902116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:05.918267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd423f-e78f-46cc-aab0-a302a9c8d498 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:05.957416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:05.958077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:05.958420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:05.958635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.035377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.036893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.039119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff61686-92ca-452c-be6d-6435a59aa32c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.080424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.081024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.081304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.081577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.110463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:06.120213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:06.166896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 226/448] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:19:06.173001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:06.179934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.181424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.272293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317e188-38bb-4d44-8478-8c651b54652c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.283769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 223/449] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:19:06.289982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:06.307132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.308025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.308309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.308610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] PATH_INFO: `/v3/projects/76422a4580c642aba304d169fbc7cc5d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.309801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] RBAC: Authorizing `identity:get_project(project_id=76422a4580c642aba304d169fbc7cc5d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.311269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.312999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 227/450] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:06 2022] GET /identity/v3/projects/76422a4580c642aba304d169fbc7cc5d => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:06.318492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:06.342596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:06.346303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:06.392410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e66c92-6ee4-4f47-86bb-9bfa8917ad1a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.421337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3d1a-165a-4a63-aa1a-812e52bb8a3a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.430908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.431810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.432099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.432385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] PATH_INFO: `/v3/projects/728349d622174859ba2f65ffafdfe844` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.433617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] RBAC: Authorizing `identity:get_project(project_id=728349d622174859ba2f65ffafdfe844)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.435085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.437063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 224/451] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:19:06 2022] GET /identity/v3/projects/728349d622174859ba2f65ffafdfe844 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:06.442714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:06.463197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.464113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.464384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.464668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] PATH_INFO: `/v3/groups/4b927e18c5a54882a9fa2848acc29d1a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.465864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] RBAC: Authorizing `identity:get_group(group_id=4b927e18c5a54882a9fa2848acc29d1a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.467335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.468996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 228/452] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:06 2022] GET /identity/v3/groups/4b927e18c5a54882a9fa2848acc29d1a => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:06.475216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:06.544451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201f2e3-2ba2-495e-b6d1-cb446b4b50c2 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.566066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:06.568944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:06.576379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861ebd-5145-43c0-92c9-d18ee1b81353 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.580098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.580955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.581239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.581516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] PATH_INFO: `/v3/groups/1e449890d00e4d4797b8656f0f47502d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.582721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] RBAC: Authorizing `identity:get_group(group_id=1e449890d00e4d4797b8656f0f47502d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.584253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.586063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 225/453] 10.222.0.25 () {56 vars in 1180 bytes} [Thu May 19 16:19:06 2022] GET /identity/v3/groups/1e449890d00e4d4797b8656f0f47502d => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:06.591722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:06.610345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.610927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.611214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.611491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.612970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] RBAC: Adding query filter params (group.id=4b927e18c5a54882a9fa2848acc29d1a, role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=76422a4580c642aba304d169fbc7cc5d) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:06.613286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.614769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db3ca9-ce97-4c7b-9099-de1302d53073 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.621823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 229/454] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:19:06 2022] GET /identity/v3/role_assignments?group.id=4b927e18c5a54882a9fa2848acc29d1a&scope.project.id=76422a4580c642aba304d169fbc7cc5d&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:06.700066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf39ec-c98f-4452-b260-f280f5a36576 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:06.737571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:06.738241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:06.738526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:06.738802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:06.739676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] RBAC: Adding query filter params (group.id=1e449890d00e4d4797b8656f0f47502d, role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=728349d622174859ba2f65ffafdfe844) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:06.739998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:06.741496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc267-73b9-44a6-9366-f0e30bc84ffb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:06.748191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 226/455] 10.222.0.25 () {56 vars in 1376 bytes} [Thu May 19 16:19:06 2022] GET /identity/v3/role_assignments?group.id=1e449890d00e4d4797b8656f0f47502d&scope.project.id=728349d622174859ba2f65ffafdfe844&role.id=627731b88fe44de39e8e182a119e4c00 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:09.701842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c85b5-5765-42a7-bef5-cc7c8fbc7ae8 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:09.701842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c85b5-5765-42a7-bef5-cc7c8fbc7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:09.701842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c85b5-5765-42a7-bef5-cc7c8fbc7ae8 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:09.701842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 230/456] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:09.709263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:09.710317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:09.710835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:09.740780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:09.742349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:09.787323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122b6a-c72e-429c-ae30-509c23c93e90 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:09.787670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122b6a-c72e-429c-ae30-509c23c93e90 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:09.787908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122b6a-c72e-429c-ae30-509c23c93e90 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:09.790977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 231/457] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:09.801974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:09.808683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73757b30-a149-40aa-b54e-26ebc266f3cf None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:09.809015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73757b30-a149-40aa-b54e-26ebc266f3cf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:09.809236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73757b30-a149-40aa-b54e-26ebc266f3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:09.821659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 227/458] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:09.845768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-73757b30-a149-40aa-b54e-26ebc266f3cf None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:09.847885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-73757b30-a149-40aa-b54e-26ebc266f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:09.875234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:09.984058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 232/459] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:09.985316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bacb8-167c-4e6c-a77e-75d92be1f08a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:09.985795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bacb8-167c-4e6c-a77e-75d92be1f08a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:09.986233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bacb8-167c-4e6c-a77e-75d92be1f08a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:09.987765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 233/460] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:09.994497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:09.995049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:09.995558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.020096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:10.022420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:10.032246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f885eda-eb75-420b-9091-489ac6579e85 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.076998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.078064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.078504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.078975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.090757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.092641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:10.111295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:10.112369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:10.113272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:10.113272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:10.113272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:10.113272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:10.113500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 234/461] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:10.113500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.120372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 228/462] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:10.121562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.144469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:10.180658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:10.238560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d8e8-bcb9-4bf7-825c-42cfa59e7742 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.256071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9626ca-6c69-44a2-bb6a-34efa3bec768 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.276253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.277507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.277809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.278092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.293236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.294983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.298258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.299202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.299786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.300475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.301432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:10.301960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.303754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:10.316949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:10.317894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:10.318831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:10.318831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:10.318831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:10.318831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:10.320599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 229/463] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:10.322580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.327476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 235/464] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:10.327476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.410450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:10.454918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:10.457694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ef33c-3585-4fe3-bd41-852f2d034953 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.459637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a313-01dd-4130-809a-265cd8194105 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.501487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.502081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.502369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.502647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.504152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:10.504489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.505649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.506504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.506780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.507215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.507668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.520533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.522042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.533376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 236/465] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:10.533376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b03e4035-2115-464c-9b2a-f4c5ab4ded87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:10.547935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:10.548909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:10.550303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:10.550303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:10.550303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:10.550303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:10.550303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 230/466] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:10.551448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e51f-5e53-4992-b4f9-ee027727c261 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.551763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e51f-5e53-4992-b4f9-ee027727c261 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.552043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e51f-5e53-4992-b4f9-ee027727c261 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.553534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 231/467] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:10.554004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e51f-5e53-4992-b4f9-ee027727c261 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.661698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924856-90ab-4755-8ecd-b73b48a9b723 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.684907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e51f-5e53-4992-b4f9-ee027727c261 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:10.688628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:10.698733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a48d-109d-4223-9368-934d87448365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.699406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a48d-109d-4223-9368-934d87448365 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.699726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a48d-109d-4223-9368-934d87448365 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.699998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a48d-109d-4223-9368-934d87448365 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.700720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a48d-109d-4223-9368-934d87448365 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.702182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a48d-109d-4223-9368-934d87448365 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.736251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637d973-b88e-4ddc-b3b0-5ed210a4069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:10.737009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d973-b88e-4ddc-b3b0-5ed210a4069f None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.737801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d973-b88e-4ddc-b3b0-5ed210a4069f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.738115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d973-b88e-4ddc-b3b0-5ed210a4069f None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.738832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637d973-b88e-4ddc-b3b0-5ed210a4069f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:10.740430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637d973-b88e-4ddc-b3b0-5ed210a4069f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:10.744091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 237/468] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:19:10 2022] POST /identity/v3/users => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:10.745599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a48d-109d-4223-9368-934d87448365 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:10.775737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 232/469] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:19:10 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:10.775737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf667-2425-448e-859e-45d71450f4e3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.775737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf667-2425-448e-859e-45d71450f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.775737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf667-2425-448e-859e-45d71450f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.812123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:10.817606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a2ecf667-2425-448e-859e-45d71450f4e3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:10.819104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a2ecf667-2425-448e-859e-45d71450f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:10.975447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 233/470] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:10.977005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b36c-a536-4d94-a73e-3c3fedbd55b8 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.977619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b36c-a536-4d94-a73e-3c3fedbd55b8 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.977619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b36c-a536-4d94-a73e-3c3fedbd55b8 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.982425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 234/471] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:10.985306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:10.985589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:10.985898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:10.988651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a48d-109d-4223-9368-934d87448365 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.011911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:11.013530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:11.044903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.045521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.045817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.046119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.046871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:11.047178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:11.048697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:11.065589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 238/472] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:11.066469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.101515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 235/473] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:11.104496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.127598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:11.196024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:11.213394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18699-1296-4ebc-af12-a9c7fdf7c080 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.235471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9def2-d397-443e-acf6-541d48e0a3dd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.251610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.252875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.253380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.253859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.265374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:11.267210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:11.280244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.280925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.281208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.281487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.282268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:11.283786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:11.289894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:11.290761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:11.291635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:11.291635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:11.291635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:11.291635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.293712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 239/474] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:11.295785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.311811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 236/475] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:19:11 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:11.312754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.454275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c0fc-dc6b-420e-832f-e2e35302845c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.486151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:11.496706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.497544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.497933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.498314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.499173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:11.499600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:11.501321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:11.517067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 237/476] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:11.523858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.545507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:11.559544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f489a-3741-4558-9722-d33e5843c4e8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.615189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.616273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.616758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.617228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.618623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:11.620632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:11.630470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.sql.core [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 16:19:11.630470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 16:19:11.630470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [parameters: {'id': 'd79cf4ba5a464a01912ff86eb59e90f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 16:19:11.630470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80219) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 16:19:11.650432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a870e4d-f47d-47ad-a0d2-6ec3ba56ce10 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result = self._query(query) May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application conn.query(q) May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result.read() May 19 16:19:11.652138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return ref.to_dict() May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 16:19:11.653591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application next(self.gen) May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application yield resource May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application next(self.gen) May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.session.rollback() May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.force_reraise() May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise self.value May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application session.commit() May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 16:19:11.654745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._prepare_impl() May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.session.flush() May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._flush(objects) May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application compat.raise_( May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application flush_context.execute() May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rec.execute(self) May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 16:19:11.656051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 16:19:11.658141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result = self._query(query) May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application conn.query(q) May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result.read() May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 16:19:11.660395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [parameters: {'id': 'd79cf4ba5a464a01912ff86eb59e90f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:11.662346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 16:19:11.665374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.668033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 240/477] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 19 16:19:11 2022] POST /identity/v3/roles => generated 144 bytes in 363 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:11.668033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.721011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.722853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.723351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.723866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.726185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:11.727971 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:11.756072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 238/478] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:19:11 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:11.802201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f806354-df18-4b80-bf0a-8cbefc9db84c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:11.843957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ee963-8b74-43d4-b028-965dfe305ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:11.844747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee963-8b74-43d4-b028-965dfe305ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:11.845082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee963-8b74-43d4-b028-965dfe305ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:11.845359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee963-8b74-43d4-b028-965dfe305ce1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:11.859788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ee963-8b74-43d4-b028-965dfe305ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-1f6ee963-8b74-43d4-b028-965dfe305ce1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:11.869546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:11.870531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 16:19:11.871334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:11.875641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 241/479] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:11.877219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:11.959233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:12.042375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77acf8d-b789-46af-9720-8a888047f918 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:12.081482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:12.082179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:12.082460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:12.082738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:12.083535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:12.083951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:12.085542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a05887-2ba3-4358-924e-b3343a49d515 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:12.095976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 239/480] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:13.289519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72aa19-12b7-4a06-a47a-a46e53bea741 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:13.290017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72aa19-12b7-4a06-a47a-a46e53bea741 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:13.290017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72aa19-12b7-4a06-a47a-a46e53bea741 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:13.291891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 242/481] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:13.297175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3e40-4030-4f30-af7d-9e8793f07e25 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:13.297578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3e40-4030-4f30-af7d-9e8793f07e25 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:13.297760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3e40-4030-4f30-af7d-9e8793f07e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:13.320616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3c7f3e40-4030-4f30-af7d-9e8793f07e25 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:13.321825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3c7f3e40-4030-4f30-af7d-9e8793f07e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:13.421896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 240/482] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:13.461256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72aa19-12b7-4a06-a47a-a46e53bea741 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:13.491072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:13.569379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf37ed-eb29-4760-9453-64c0e006f8ac None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:13.569668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf37ed-eb29-4760-9453-64c0e006f8ac None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:13.569856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf37ed-eb29-4760-9453-64c0e006f8ac None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:13.571458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 241/483] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:13.581269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145837-da4f-456f-a817-573e69edb4ef None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:13.581610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145837-da4f-456f-a817-573e69edb4ef None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:13.581825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145837-da4f-456f-a817-573e69edb4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:13.615142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72aa19-12b7-4a06-a47a-a46e53bea741 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:13.624379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-01145837-da4f-456f-a817-573e69edb4ef None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:13.625577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-01145837-da4f-456f-a817-573e69edb4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:13.675365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:13.694880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:13.695731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:13.696071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:13.696355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:13.717713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:13.725848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:13.726774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:13.727571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 243/484] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:13.739646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:13.764033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 242/485] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:13.798914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145837-da4f-456f-a817-573e69edb4ef None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:13.850193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:13.874676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987cdd1-9abd-4980-90cc-d97f7d504576 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:13.941337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:13.942228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:13.942515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:13.942794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:13.943550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:13.943886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:13.945289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:13.961983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 244/486] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:13.967356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.001085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145837-da4f-456f-a817-573e69edb4ef None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.077324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.078142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.078423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.078697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.103926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:14.121413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:14.122353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:14.123155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 243/487] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:14.129310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.135589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e64047-54fd-45d7-9532-f4b761057a8b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.168964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:14.175947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.176766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.177048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.178050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.198026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:14.203524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:14.205262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:14.224574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:14.226891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:14.229018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:14.229018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:14.229018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:14.229018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:14.229018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 245/488] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:14.237025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.336026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f469-76b5-4619-83e2-db084664181b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.399834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.400690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.400974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.401335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.402470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:14.402895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:14.406935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bfc74-6d72-48d3-94ec-bf62005639a9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.411047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:14.428848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 244/489] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:14.435228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.460020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.460760 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.461043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.461323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.462123 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:14.462454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:14.463972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:14.489669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 246/490] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:14.496537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.607346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:14.609549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:14.636394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45400f-0ac5-43af-88f3-8723a1ea49f4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.673612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.673937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2537ec-f78e-4ddc-80d3-598a6c104309 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.674336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.674655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.674936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.686223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:14.687748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-760c131b-f44d-444d-92a1-9f75aa545f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:14.706806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:14.708889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 245/491] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1de93-5a11-469d-adce-a732f0761022 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1de93-5a11-469d-adce-a732f0761022 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.710956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1de93-5a11-469d-adce-a732f0761022 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.712053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 246/492] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:14.716718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1de93-5a11-469d-adce-a732f0761022 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.721033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.722197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.722695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.723210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.731715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:14.733549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-e877cf1f-d6dd-4583-addd-5bd5800b0398 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:14.750745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:14.751769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:14.753220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:14.758944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 247/493] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:14.758944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.758944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.758944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.780775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:14.782396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:14.836255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1de93-5a11-469d-adce-a732f0761022 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:14.867639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 248/494] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:14.867639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.879181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:14.880226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.880516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.880793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.881527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:14.881885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:14.883911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcafb-6917-40ff-ae4a-a00e37b58b42 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:14.885978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:14.901036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 247/495] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:14.901983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cb584-e52d-4d8d-b871-84e96d93c0f3 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:14.902274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cb584-e52d-4d8d-b871-84e96d93c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:14.902548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cb584-e52d-4d8d-b871-84e96d93c0f3 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:14.904241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 248/496] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:14.908980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cb584-e52d-4d8d-b871-84e96d93c0f3 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:14.919293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:14.975829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1cc04-4755-4b1e-b3ad-18293af6c3cd None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.011646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.012450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.012737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.013028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.013868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:15.014178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.015647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.031026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cb584-e52d-4d8d-b871-84e96d93c0f3 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.052412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 249/497] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:15.053247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.068739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96686c-cce8-4316-8748-aec240d2c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.069534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96686c-cce8-4316-8748-aec240d2c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.069817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96686c-cce8-4316-8748-aec240d2c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.070096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96686c-cce8-4316-8748-aec240d2c2f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.080353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96686c-cce8-4316-8748-aec240d2c2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-da96686c-cce8-4316-8748-aec240d2c2f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:15.088181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:15.089085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:15.089896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 249/498] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:15.090831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845f34-eb81-406f-8909-b037b6606737 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.090966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845f34-eb81-406f-8909-b037b6606737 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.091251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845f34-eb81-406f-8909-b037b6606737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.107238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1a845f34-eb81-406f-8909-b037b6606737 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:15.108478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1a845f34-eb81-406f-8909-b037b6606737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:15.154289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.157925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2d1e-1f0b-4db8-a53c-6bad7d556d7a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.159086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.177842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 250/499] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:15.179326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c753a3-862f-4a67-8edc-71a24012ba41 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.179760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c753a3-862f-4a67-8edc-71a24012ba41 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.180062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c753a3-862f-4a67-8edc-71a24012ba41 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.181592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 251/500] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:15.182238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c753a3-862f-4a67-8edc-71a24012ba41 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.203033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.204256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.204541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.204826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.212150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.213620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:15.228529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:15.229425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:15.230350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 250/501] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:15.231409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.293288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c753a3-862f-4a67-8edc-71a24012ba41 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.327126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.327787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.328069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.328342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.328668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf609e4-404f-4794-9e65-2950ce5c0412 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.365630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.366295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.366583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.366861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.367607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:15.367952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.369743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57b20e-5c96-4527-9706-571d26f06be1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.378022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 251/502] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:15.379229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.379533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.379833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.381125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.395956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:15.397147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:15.399986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.401460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.413910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.465628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 252/503] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:15.466464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.507929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 252/504] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:15.509042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.570122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdbae7-7429-4636-b7df-4eb2e3504773 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.596160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.605737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.606532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.606812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.607093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.613513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42c0d1-038d-421d-9074-db4a4de3e618 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.618263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.619749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:15.636955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:15.638010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:15.639077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:15.639077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:15.639077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:15.639077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:15.639077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 253/505] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:15.639077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.642404 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.653737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.654422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.654692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.654967 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.655841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:15.656152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.657601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.704629 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 253/506] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:15.705578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.744142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e3e2-e618-4e60-91e5-ff6316e13559 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.777298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.778016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.778548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.778821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.789851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.791321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.805507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654247c-d48d-4ba0-9cf1-84f831e45c4f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:15.808124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:15.809167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:15.810062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:15.810062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:15.810062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:15.810062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:15.810062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 254/507] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:15.810450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.840926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.841716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.841997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.842273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.852878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:15.860602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:15.861689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:15.862494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 254/508] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:15.863149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:15.865242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.868580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:15.915395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e0ac-b4e2-4a9f-b34a-4429adf5d8c6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.948270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:15.949060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:15.949346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:15.949622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:15.960686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:15.962204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:15.967556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4764e1-2da2-41a3-bef5-d5ec8d5a2e7d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:15.980254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:15.981134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:15.981978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:15.981978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:15.981978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:15.981978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:15.981978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 255/509] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:15.982340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.006504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.007164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.007449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.007765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.008492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:16.008805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.010215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.022383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 255/510] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:16.023176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.087020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42b4f9-28f7-428c-bd18-15acb3956abc None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.096569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.101616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.126939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.128176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.128464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.128740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.146022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5f31-a69e-446b-8288-3b319f9f4b1b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.179324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.180029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.180326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.180586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.181308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:16.181619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.183016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.194715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 256/511] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:16.195386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.195594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.196899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.294094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 256/512] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:16.294949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.297617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cae11-4820-4d72-b8a6-6e2ddbee9649 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.306966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.320567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.333173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.333913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.334200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.334474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.335219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:16.335525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.336950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.345173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 257/513] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:16.345692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.401293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b2cb6-1397-46b8-893c-aa896b6663d9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.437124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.438040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.438040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.438337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.439039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:16.439350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.441325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.448872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db1d50-9178-4bfb-a511-c84fa911c1fd None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.452790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 257/514] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:16.453593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.486516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.487750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.488033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.488312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.489022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.490477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.510247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 258/515] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:19:16 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:16.511062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.537227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.568189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.582292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944014a-f286-49cf-b752-fa434db84d8f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.622998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.623757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.624049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.624330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.633931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.635426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.641970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180595-1eed-4a4c-9dbb-525b7b7da33e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:16.651238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:16.652567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 258/516] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:16.654046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.687265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.688101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.688386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.688661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.701752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.703237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:16.723275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:16.724522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:16.725659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:16.725659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:16.725659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:16.725659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:16.725659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 259/517] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:16.725659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.779588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f23d0-3d7f-469f-ae9d-c69183067b15 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.810003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.821149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.822237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.822735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.823213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.827080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:16.837451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f6be-135f-4493-a327-78d11a40f01d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:16.837717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.839192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:16.857501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:16.858398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:16.859242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:16.859242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:16.859242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:16.859242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:16.859242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 259/518] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:16.859544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.881384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:16.882112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:16.882398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:16.882676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:16.893160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:16.893160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:16.907942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:16.909507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:16.910452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 260/519] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:16.910948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:16.986694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385245-ffc8-402d-9f00-43b58fb2d9e5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.023102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.023812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.023931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d874-55a9-4da1-9194-c23739fbc85c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.024099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.024376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.025217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:17.025533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.027002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.045701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 260/520] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:17.050821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.071590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.072672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.073683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.074164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.075360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:17.076142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.078438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.091432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 261/521] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:17.092263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.098202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.109688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.168478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99234-d9df-4567-b830-0d6e24be3d4c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.203359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.204210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.204502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.205083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.206499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:17.206814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.207873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eef35e-8535-4bcd-b674-1b1237fe1f2e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.208224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.225529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 261/522] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:17.225529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.250493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.251254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.251545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.251932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.252898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:17.253249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.254927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.275441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 262/523] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:17.276524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.339177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.343778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445c234-f979-4c21-ba0b-f0515344ac0d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.355012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.381499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.382157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.382445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.382725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.387989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe293-4e34-42c2-9b57-81520951380f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.431652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.432397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.432675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.432953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.439969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.441459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:17.456422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:17.457938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 263/524] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:17.458909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.465011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.466504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.568199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.571046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49cc50-2f73-4452-a8dd-9c77d8396dc1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.572434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 262/525] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:17.576929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.605956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.612835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.613656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.613941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.614217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.622719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.624229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:17.640328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:17.641438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 264/526] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:17.642703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.688047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aba77-8aa6-4e1a-988d-8ddcceca9e73 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.728348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.729026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.729312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.729590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.730564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=87dd16048e5244f4adc3f5859d6ea8e9) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:17.730881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.732542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.738902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 263/527] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/role_assignments?user.id=87dd16048e5244f4adc3f5859d6ea8e9&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:17.739719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.761905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5fbd-32ca-48f1-bebc-fce8cf3f29e9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.811957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.812777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.813130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.813474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.814733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:17.815594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.817167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.829160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.835489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 265/528] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:17.836460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.878702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa285-7253-40cf-8046-faf54d118944 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:17.903411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:17.920320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:17.921551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:17.922096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:17.922576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:17.935376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:17.937262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:17.958186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:17.959090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:17.960375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:17.960375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:17.960375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:17.960375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:17.960375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 264/529] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:17.960950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:17.965174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250747f-ca2a-470d-b0d1-425ddcf28271 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.004291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.005340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.005627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.005953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.007406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:18.007773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.009773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.035730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 266/530] 10.222.0.25 () {56 vars in 1139 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:18.036625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.069749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19b20-a489-4562-ad07-deb889a2c4ed None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.090086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:18.104939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.105609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.105903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.106187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.107031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=e01bb2821eec4234917742be62b441ac) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:18.107357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.108861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.119753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 265/531] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:17 2022] GET /identity/v3/role_assignments?user.id=e01bb2821eec4234917742be62b441ac&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:18.120733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.162308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576dc25-4255-479c-9ded-e90c8f7acbdf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.176068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:18.205567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.206266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.206550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.206827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.207583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:18.207926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.209933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.224451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 267/532] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:18.231331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.364422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ea4e-5d9d-470c-8ec9-4b380611ae65 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.383999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051886-e134-42fa-add6-25fc5728c11a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.421488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.422284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.422563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.422835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.434477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.435982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.443311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.444009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.444297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.444591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:18.465012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:18.466224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:18.467091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 268/533] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:18.475978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.517990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:18.535255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:18.547278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.547278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.652605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 266/534] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:18.658375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.686762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e99786-2a9c-44bf-86c0-7134386937f3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.752092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:18.757267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.757958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.758239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.758515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.759314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:18.759646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.761103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.768973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a38f7-b1ef-43da-bc3c-066491de4eb6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:18.775947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 269/535] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:18.785982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.837456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:18.838258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:18.838534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:18.838807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:18.854733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:18.856250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:18.874028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:18.875203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:18.876298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:18.876298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:18.876298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:18.876298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:18.879806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 267/536] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:18.881025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:18.993860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c0c4-0a2e-4624-bfc4-bd15577674dc None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.025638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:19.032754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.034033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.034471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.034892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.035810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:19.036646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:19.038215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:19.055386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 268/537] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:19.056874 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:19.094889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:19.117890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255a3d-5f93-40ab-8ec1-9bcf155c5e0d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.165635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.166438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.166724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.167030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.168138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=e9abdf0cdb63429d926f201034fb72ed) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:19.168499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:19.170038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501f748-e716-4402-8a53-b1bf02eda89f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:19.175777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8763e4b-8380-49aa-82e8-e3db7c229050 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.177537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 270/538] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:18 2022] GET /identity/v3/role_assignments?user.id=e9abdf0cdb63429d926f201034fb72ed&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:19.184765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116615ae-8bcc-42da-b7bb-a5e901281bf9 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.185110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116615ae-8bcc-42da-b7bb-a5e901281bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.185386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116615ae-8bcc-42da-b7bb-a5e901281bf9 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.187311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 271/539] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:19.194149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.194476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.194698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.232459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.233300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.233582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.233857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.235672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:19.236972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:19.251584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:19.253685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:19.277482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:19.278634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:19.279491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 269/540] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:19.284934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:19.389665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 272/541] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:19.396511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:19.414698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:19.464847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135694d-c8a3-4319-a832-f3f905dd1b57 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.516505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.517199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.517488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.517769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.518608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:19.519145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:19.520532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:19.528567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:19.543772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 270/542] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:19.551989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:19.552742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0c6aa-6058-46cf-af84-7a2aed5ef8fd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.590655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.591607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.592019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.592386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.603836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:19.612895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:19.614081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:19.615137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:19.617794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 273/543] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:19.623654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:19.741059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec99562-84e8-47d0-a2b1-fe19b01a17dd None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.791106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2fe3-24c0-4602-b509-b2d90aa9426d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.797793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.802896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.803426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.803936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.804914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:19.805428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:19.807774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:19.813860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:19.820571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 274/544] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:19.825834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:19.840015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:19.853430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.854605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.855185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.855722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:19.856780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=6ae2e3c1b1b04ce7950a81c33308d560) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:19.857415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:19.859212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:19.872956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 271/545] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:19 2022] GET /identity/v3/role_assignments?user.id=6ae2e3c1b1b04ce7950a81c33308d560&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:19.955278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd7645-ccf3-4d2e-a1e5-86a473c75cdb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:19.992691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:19.993494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:19.993774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:19.994050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.006562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:20.008097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:20.026945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:20.027940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:20.029472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:20.029472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:20.029472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:20.029472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:20.029472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 275/546] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:20.034463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:20.164232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcfca6-d71f-40b9-86ac-a37b307dc127 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:20.199335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:20.200049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:20.200331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:20.200605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.201355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:20.201636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:20.203016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:20.216448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 272/547] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:20.224967 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:20.309253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:20.356319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e19dc-ef5b-4286-bade-5c4357c7b4ea None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:20.398697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:20.399941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:20.400367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:20.400792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.410983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:20.412848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-28d22661-b089-4452-9d38-dc76943e6fcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:20.428126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:20.430272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:20.431563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 276/548] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:20.435195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:20.476950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:20.571024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bca72-2e99-4c20-9b0f-704f2c2c5438 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:20.605158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8621a-f3e9-4ea3-a1c3-3ff464f0acad None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:20.605666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8621a-f3e9-4ea3-a1c3-3ff464f0acad None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:20.605771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8621a-f3e9-4ea3-a1c3-3ff464f0acad None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.607224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 277/549] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:20.613267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:20.613579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:20.613823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.628445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:20.629446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:20.629724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:20.629996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.630863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:20.631173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:20.632707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:20.633349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:20.634674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:20.670642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 273/550] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 19 16:19:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:20.676661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:20.766853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 278/551] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:20.827500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:20.834818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:20.845200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ab6db-c22c-4e6c-ae67-e6d71100665d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:20.892611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:20.893356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:20.896199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:20.896503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:20.901586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:20.975152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:20.976917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:20.981752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fcdd1-5a5a-4d4a-9a5e-c54897cef96f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.029253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904c23-c1d3-41bb-a981-23708d20fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.030382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904c23-c1d3-41bb-a981-23708d20fe50 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.030668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904c23-c1d3-41bb-a981-23708d20fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.030941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904c23-c1d3-41bb-a981-23708d20fe50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.045163 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904c23-c1d3-41bb-a981-23708d20fe50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b9904c23-c1d3-41bb-a981-23708d20fe50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:21.054519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:21.055676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:21.056506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:21.057146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 279/552] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:21.058522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a70d-edcb-4445-a88f-bd72c2e0750b None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.063633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a70d-edcb-4445-a88f-bd72c2e0750b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.063633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a70d-edcb-4445-a88f-bd72c2e0750b None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.063633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 280/553] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:21.067868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123295c3-f956-4b38-881d-2532cb599636 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.068228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123295c3-f956-4b38-881d-2532cb599636 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.068569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123295c3-f956-4b38-881d-2532cb599636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.084437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.087928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-123295c3-f956-4b38-881d-2532cb599636 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:21.089672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-123295c3-f956-4b38-881d-2532cb599636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:21.097917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 274/554] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:21.099291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.183812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 281/555] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:21.184772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123295c3-f956-4b38-881d-2532cb599636 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.246156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3b89-4fcf-40df-9b16-45c0d0a8e8f6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.252024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.297843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.298498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.298787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.299694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.300531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:21.300849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:21.303165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:21.317264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 275/556] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:21.318242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.335221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123295c3-f956-4b38-881d-2532cb599636 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.375761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.376772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.377080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.377966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.389714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:21.391278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:21.396120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:21.418320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:21.420448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:21.422523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:21.422523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:21.422523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:21.422523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:21.422523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 282/557] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:21.422523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.449484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf95b-d16c-451a-be72-88a0ac24e1a8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.493135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.494333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.494825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.495253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.510526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:21.522101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:21.523842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:21.524910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:21.531949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 276/558] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:21.533365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.546573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.560414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6695-e6b3-4be0-a42a-193df0cc016d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.607097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.608028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.608430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.608779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.620806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:21.622382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:21.643132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:21.644130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:21.645123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:21.645123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:21.645123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:21.645123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:21.649240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 283/559] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:21.650343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.664993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97c3f3-8cc7-48b5-af89-98e398220723 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.686948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.715231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.716221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.716514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.716794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.717526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:21.717841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:21.719897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:21.736508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 277/560] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:21.737970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.784378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af9f0-1dd3-4026-a0b0-714f173a96ec None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.822202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.822824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.823149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.823433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.824414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:21.824541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:21.825991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:21.839741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 284/561] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:21.840734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.846364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.869794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f2960-aca4-41bc-a185-bee2344356a5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.918650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.919325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:21.919634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:21.919926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:21.920658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:21.920968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:21.922356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:21.937455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 278/562] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:21.941397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:21.961605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf0f6a-5b36-47de-a67c-0402d0c35891 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:21.985913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:21.999135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:21.999953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.000238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.000518 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.007582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.009079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-0817adac-3c5e-4443-a0a9-185d3d06c1b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:22.026964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:22.028228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:22.029138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 285/563] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:22.030482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4475723-c77e-4f56-9f63-b1723118038a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.030764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4475723-c77e-4f56-9f63-b1723118038a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.031137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4475723-c77e-4f56-9f63-b1723118038a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.035660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 286/564] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:22.035660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4475723-c77e-4f56-9f63-b1723118038a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.071819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70eb52-6f5b-4608-9cec-381857ec5098 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.103825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.108088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.108891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.109174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.109448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.120918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.122370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:22.141291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:22.142240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:22.143188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:22.143188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:22.143188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:22.143188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:22.143188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 279/565] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:22.144103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.152214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4475723-c77e-4f56-9f63-b1723118038a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.193115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.193931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.194313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.194583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.203577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.205079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-7c7dae4f-d284-428c-ab15-2f03131c9f9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:22.221792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:22.222896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:22.224180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 287/566] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:22.224783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.224783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.224783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.242155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:22.243326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:22.246938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.268842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504222-73ce-4808-b5c9-c18c3b607754 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.308025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.308778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.309062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.309341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.310240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:22.310591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.312220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.320960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 288/567] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:22.321861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.335709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 280/568] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:22.337007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.395435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.444162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d922565-9b03-45a3-8852-e99223fc4d01 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.448822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5ab1-bc9d-460e-821d-ec6ebbef27a2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.484955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.485628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.485915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.486195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.487280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.487569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:22.487910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.488008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.488234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.488505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.489219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:22.489387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.489545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.491003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.508280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 289/569] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:22.508280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.513112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 281/570] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:22.513964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.517842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.609631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9732dd8-05e0-4bcd-ba6a-6eb85a096478 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.619654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ac8a3-d49a-43a6-9d0f-6ed1cff16a65 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.628833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.649734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.650361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.650682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.650958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.651892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=d270113b79534fadbb15eb81eb547a5c) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:22.652249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.654125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c90af-fd4b-4642-b0eb-97ce426acaab None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.655029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.655855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.656147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.656425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.660080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 290/571] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/role_assignments?user.id=d270113b79534fadbb15eb81eb547a5c&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:22.661390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ad685-9b22-48f4-bbf6-7f7a316d22cb None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.661714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ad685-9b22-48f4-bbf6-7f7a316d22cb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.662029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ad685-9b22-48f4-bbf6-7f7a316d22cb None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.663569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 291/572] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:22.664374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ad685-9b22-48f4-bbf6-7f7a316d22cb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.667921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:22.676927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:22.678153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 282/573] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:22.679086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.758529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.789662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ad685-9b22-48f4-bbf6-7f7a316d22cb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.806556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f68de-f03a-4135-a081-0aab6845361b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:22.828222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.829275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.829610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.829945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.840300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.842178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.847193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:22.847534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.848126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.848126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.861094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-741849ec-2db8-45f4-8e15-cabfbdba421d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:22.862671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:22.863861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:19:22.865011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:22.866260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:22.869185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 292/574] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:22.870367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:22.870655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:22.870972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:22.888366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:22.889652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:22.890802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:22.890802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:22.890802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:22.890802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:22.891057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:22.891164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 283/575] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:22.894861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:22.895024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:22.931843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:22.979679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 293/576] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:22.979679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.019939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4cd29-fe30-420c-a5a2-fa70f2dedc5d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.041007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.061167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.061833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.062113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.062388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.063132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:23.063436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.064897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.078106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 284/577] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:23.078106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.097187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fd610-9919-4ef2-8cf4-5b09019d985e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.134842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.135649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.136019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.136345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.137187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:23.137506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.138951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.162241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 294/578] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 19 16:19:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:23.162241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.190743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f6f32-6cae-443b-8b99-ae33d2189c7f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.191696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.232160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.232829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.233111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.233392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.234121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:23.234429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.235827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.253029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 285/579] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:23.253029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.275934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415309ce-954d-407f-bc36-203e5033ad1b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.290563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.316109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.316856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.317131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.317398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.328105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:23.336415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:23.337387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:23.338254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 295/580] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:23.339767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.370586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ae772-fcf8-487f-9cf8-db3341482bc7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.418532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.419826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.420295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.421000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.432692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.434451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.453272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:23.454533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:23.456212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:23.457223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:23.457223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:23.457223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:23.457223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:23.457223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 286/581] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:23.457223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.477133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2703fd-1213-4ad8-a43e-6096d7d9548d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.521510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.522520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.523256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.523256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.535641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.537127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:23.556791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:23.557938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:23.558932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:23.558932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:23.558932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:23.558932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:23.558932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 296/582] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:23.559220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.575857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.589475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eff7b-0afe-4ab8-b7c9-5683ba4e64c6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.629296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.630086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.630373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.630653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.638794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.639193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:23.655253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:23.656246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:23.657126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 287/583] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:23.657606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.683304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bfeb6-27ea-4b6f-b8c8-3a6345b87b44 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.720636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.721574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.722135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.722567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.723520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:23.723996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.725532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.731689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.737784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 297/584] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:23.738608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.773007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992bb8d-3dc1-4542-807c-adc36bb91667 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.811348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.812051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.812335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.812619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.813332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:23.813759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.815934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.833222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 288/585] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:23.833222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.843568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:23.859175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f34d-4e5a-4b4a-8f23-7221831af27e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:23.906441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:23.907104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:23.907384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:23.907677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:23.908400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:23.908735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:23.910121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:23.938081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 298/586] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:23.938081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:23.952522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc55a1d-a870-4775-8848-83526fd1e0b9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.004374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.005054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.005423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.005705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.006989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:24.006989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.008444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.009943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.022252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 289/587] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:24.023175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.063298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba773d-4654-4abd-b89b-c89d89752ad4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.103448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.104385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.104499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.104721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.105004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.120663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.121896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.138839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d40f02-5e4e-45e2-84a9-ac63357a2b1c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:24.141588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:24.142513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:24.143461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:24.143461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:24.143461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:24.143461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:24.143461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 299/588] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:24.143790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.180186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.181336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.181821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.182280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.191527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.193272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:24.208720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:24.209724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 16:19:24.210748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:24.212685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 290/589] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:24.213619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.273599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53fc9c-34de-470a-8405-6e627f40336f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.304482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.331828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.332645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.332921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.333207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.340662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.342152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.356619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd76ad-1a04-40da-b0af-789ff7013da2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:24.364731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:24.366115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 300/590] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:24.367177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.393849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.401409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.402509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.403121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.403705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/87dd16048e5244f4adc3f5859d6ea8e9/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.423043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=87dd16048e5244f4adc3f5859d6ea8e9, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.425274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.440371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 291/591] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:24 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/87dd16048e5244f4adc3f5859d6ea8e9/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:24.441322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.519554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d111111-0fef-40d1-88e2-93c7e6eb1368 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.584026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f680-75af-4aff-8110-61071654977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.584720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f680-75af-4aff-8110-61071654977d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.585672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f680-75af-4aff-8110-61071654977d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.585942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f680-75af-4aff-8110-61071654977d None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.587093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f680-75af-4aff-8110-61071654977d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:24.587412 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f680-75af-4aff-8110-61071654977d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.589682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f680-75af-4aff-8110-61071654977d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.600327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592b53-45d2-40d1-b35f-2ea7f526f606 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.612999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 301/592] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:24.613918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f680-75af-4aff-8110-61071654977d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.655818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.656520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.657090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.657375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.659396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:24.660039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.661853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.662714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.686844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 292/593] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:24.687416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.737437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.765786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f680-75af-4aff-8110-61071654977d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.809024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.810374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.810863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.811345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.812359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:24.812954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.814919 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.826928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d277-3b09-4b8b-80da-43f2876e65ff None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:24.835473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 302/594] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:24.836769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.868127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:24.868945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:24.869545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:24.869655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:24.877804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:24.879289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:24.896568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:24.897509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 16:19:24.898455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:24.903145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 293/595] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:24.904227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:24.951550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:24.961440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad73eb-fecc-41c9-b244-082b8d0e5dc3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.004928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.005986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.006691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.006974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.012110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.016746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270eeb-736a-4ce8-b4b0-a7c2d9d9681e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.019948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.021428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:25.042494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:25.043672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:25.045373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:25.045373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:25.045373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:25.045373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:25.045373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 303/596] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:25.046949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.058298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b72f57-4af1-474c-b209-089ffb670d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.059317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b72f57-4af1-474c-b209-089ffb670d29 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.059731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b72f57-4af1-474c-b209-089ffb670d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.060102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b72f57-4af1-474c-b209-089ffb670d29 None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/e01bb2821eec4234917742be62b441ac/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.075944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b72f57-4af1-474c-b209-089ffb670d29 None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=e01bb2821eec4234917742be62b441ac, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.077542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b72f57-4af1-474c-b209-089ffb670d29 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.099745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 294/597] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:24 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/e01bb2821eec4234917742be62b441ac/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:25.099745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3ef5-3f09-4709-be04-ff09421f975f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.099745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3ef5-3f09-4709-be04-ff09421f975f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.099745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3ef5-3f09-4709-be04-ff09421f975f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.099745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 295/598] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:25.099745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3ef5-3f09-4709-be04-ff09421f975f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.185118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d203-1f67-492f-95d3-58595711106a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.232575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3ef5-3f09-4709-be04-ff09421f975f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.233505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.234318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.234900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.235274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.237287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:25.237723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.239327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278abf7-32be-4124-8fcd-d8242e86205c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.264255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 304/599] 10.222.0.25 () {56 vars in 1139 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:25.265765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.266157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.266538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.273337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.292659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:25.292659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:25.295656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.297009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.297009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.297009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.297521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:25.297832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.299216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.315501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 296/600] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:25.320462 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.333506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.386096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 305/601] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:25.386096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.469546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869cba7-0291-40f4-9fda-9f6ba7fb704f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.518631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.519435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.519751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.520031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.538821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.541170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.542222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac380b-42ea-4537-8b63-66cec0494748 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:25.563230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:25.564211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:25.565669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:25.565669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:25.565669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:25.565669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:25.566438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 297/602] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:25.568447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.588351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.596938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.598524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.599166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.599749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.611387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.614645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.635107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:25.638669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:25.640051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:25.641580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:25.645144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 306/603] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:25.649050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.679792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166bf7-b1b2-4038-b45b-3869c76b6a3b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.725386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.726473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.726764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.727049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.741881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:25.754776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:25.755795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 298/604] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:25.761419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.781289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ed36-cd0b-4eb1-9409-1763d28df27c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.830787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435231-af52-494a-88bf-35476850dd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.831716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435231-af52-494a-88bf-35476850dd4c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.832021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435231-af52-494a-88bf-35476850dd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.832305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435231-af52-494a-88bf-35476850dd4c None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.833045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58435231-af52-494a-88bf-35476850dd4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:25.833356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58435231-af52-494a-88bf-35476850dd4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.834752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58435231-af52-494a-88bf-35476850dd4c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.855752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 307/605] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:25.855752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435231-af52-494a-88bf-35476850dd4c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.880380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca12c1-9500-4c9d-aa0c-ef2d680e09ec None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:25.913768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.922477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:25.936393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:25.937391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:25.938130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:25.938631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:25.940524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:25.941164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:25.944008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:25.960123 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 299/606] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:25.961495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:25.990997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435231-af52-494a-88bf-35476850dd4c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.037936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.038653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.038939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.039209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.039986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:26.040293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.041701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.055465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 308/607] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:26.056404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:26.097148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e196b-3f18-4b72-a4ec-0488e771378a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.149338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.150844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.151681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.152150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.161456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.163552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.181539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66ba8e-08fb-4341-8209-3f68a866a2b9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:26.183297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:26.184200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:26.185206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:26.188610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 300/608] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:26.189695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:26.207360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:26.235051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.236572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.237029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.238397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/e9abdf0cdb63429d926f201034fb72ed/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.246206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:26.262141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=e9abdf0cdb63429d926f201034fb72ed, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.266001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.295909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 309/609] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:26 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/e9abdf0cdb63429d926f201034fb72ed/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:26.297882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:26.342974 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49497295-9a7b-4812-9813-c106594c5d0e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.389688 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.391115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.391701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.392266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.408279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.410537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:26.434243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:26.435253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:26.436202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:26.436202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:26.436202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:26.436202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:26.438580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 301/610] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:26.445559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:26.502309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0e52-74e8-4c54-99c6-11454bfd6135 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.550234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.556583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.556906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.557132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.558006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:26.558253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.559788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.579256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 310/611] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:26.585699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:26.622146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:26.647155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:26.660519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635c22-51c2-47b3-adc3-a57265f8a203 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.726302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6965b-f08f-47a2-a1f2-e8752b0ddc4f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.730192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.731145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.731605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.732052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.732989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:26.733446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.734980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.760201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 302/612] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:26.764815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3557ef-6c78-4429-ac61-35f8fdd9071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.765975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3557ef-6c78-4429-ac61-35f8fdd9071c None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.766256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3557ef-6c78-4429-ac61-35f8fdd9071c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.766529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3557ef-6c78-4429-ac61-35f8fdd9071c None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/6ae2e3c1b1b04ce7950a81c33308d560/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.766978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:26.787416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3557ef-6c78-4429-ac61-35f8fdd9071c None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=6ae2e3c1b1b04ce7950a81c33308d560, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.789335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3557ef-6c78-4429-ac61-35f8fdd9071c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.810617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 311/613] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:26 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/6ae2e3c1b1b04ce7950a81c33308d560/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:26.893826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df5a9-1093-45b1-8fb6-a1814a2c5a46 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:26.933160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:26.933885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.935612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55253-b55a-4a4a-b710-9eacd8289be0 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.935883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.936021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55253-b55a-4a4a-b710-9eacd8289be0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.936175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55253-b55a-4a4a-b710-9eacd8289be0 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.936485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.937919 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 312/614] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:19:26.944568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:26.944844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:26.945118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:26.952879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:26.954641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:26.964703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:26.965925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:26.980422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:26.981644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:26.982802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:26.984777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 303/615] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:26.992775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.018736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:27.068155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 313/616] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:27.099928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.104151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:27.165819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71506b4-f651-405f-871e-5376f2734fee None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.203811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.204675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.205061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.205998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.206955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:27.207373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:27.209935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:27.217846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc1bc-47a3-43d6-84a0-333c9e968bf9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.235001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 304/617] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 19 16:19:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:27.240907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.266326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.269116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.269773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.270887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.293205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:27.302174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:27.303350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:27.304428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:27.317363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 314/618] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:27.323736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.389543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:27.436221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:27.477869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1af2a-cfe7-4239-a09e-94378bfdd569 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.481299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e939f-3236-42da-8962-5875f37a4a4c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.523722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.524958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.525452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.525931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.526945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:27.527467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:27.529429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:27.539982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 315/619] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:27.545181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.598272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.599563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.600116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.600645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.615932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:27.618219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:27.642420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:27.643478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:27.644412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:27.644412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:27.644412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:27.644412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:27.651244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 305/620] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:27.653216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.718214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871474f5-6c09-49fa-814b-dcfebf333961 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.747910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:27.760021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.761211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.761727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.762206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.772229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850ee95-5cde-47a7-9923-8a6d8ffb64ae None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.776251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:27.778242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:27.797070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-6ec0be6e-9c4e-4e8c-af7b-c4c8a290c6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:27.799934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:27.801181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:27.802754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:27.802754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:27.802754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:27.802754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:27.805106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 316/621] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:27.806849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b40d3-faf9-4768-bf93-62395dd164eb None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.807378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b40d3-faf9-4768-bf93-62395dd164eb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.807880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b40d3-faf9-4768-bf93-62395dd164eb None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.811240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 317/622] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:27.812597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b40d3-faf9-4768-bf93-62395dd164eb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.820054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.820742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.821031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.821313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.822062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:27.822375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:27.823828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78e27-3576-41e0-b48e-05179dac6c9c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:27.841189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 306/623] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:27.841189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224226e1-001a-47dc-af87-525bc515f211 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.841189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224226e1-001a-47dc-af87-525bc515f211 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.841189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224226e1-001a-47dc-af87-525bc515f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.859371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-224226e1-001a-47dc-af87-525bc515f211 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:27.860623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-224226e1-001a-47dc-af87-525bc515f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:27.937018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 307/624] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:27.944269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224226e1-001a-47dc-af87-525bc515f211 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:27.956217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b40d3-faf9-4768-bf93-62395dd164eb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:27.993781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:27.994792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:27.995298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:27.995814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:27.997155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:27.997671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:27.999515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.013283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 318/625] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:28.014524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.058357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.072692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224226e1-001a-47dc-af87-525bc515f211 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.087028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.109418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.110210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.110662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.110854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.118553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.120052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.130988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fae10-1b92-4aff-8e3a-39243ab94a5a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:28.134635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:28.135773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:28.136671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:28.140595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 308/626] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:28.141459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.177107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.178284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.178768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.179261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.190948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:28.199656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:28.200604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:28.201441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:28.204299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 319/627] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:28.205534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.256778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0df8-a8cc-437a-b461-a61b6bfb3ecd None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.293231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.294036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.294324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.294604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.303489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.305026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:28.320334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:28.321353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:28.323277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:28.327167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 309/628] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:28.327167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.333225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.338178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8ea8e-e224-4479-bc36-0312931d1060 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.361028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.381072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.382240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.382749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.383235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.384353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:28.384881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.386555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.401468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 320/629] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:28.402646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.440149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf9a4-8715-4f4a-a1a3-82d865f47604 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.476707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.477383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.477715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.478047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.478812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:28.479124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.480545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.489570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 310/630] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:28.490196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.520800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd57c-cd86-4e97-ac66-d486a1766f8f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.559161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.560332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.560888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.561360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.562393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:28.562903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.564769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.584628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 321/631] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:28.585844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.599398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.606254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95772aca-6f5b-4aee-b3cd-ca0dd9b186cd None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.607579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.641866 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.644699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.644699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.644699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/d270113b79534fadbb15eb81eb547a5c/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.663903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=d270113b79534fadbb15eb81eb547a5c, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.665519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.687919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 311/632] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:28 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/d270113b79534fadbb15eb81eb547a5c/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:28.689105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.713431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd5927-53b2-405b-86c6-d79bc0ec1b60 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.762359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.763574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.764067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.765507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.790435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:28.793461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:28.833701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:28.835144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:28.836078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:28.836078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:28.836078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:28.836078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:28.842030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 322/633] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:28.848373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:28.910718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3a62a-89ad-4531-9762-a569f71693b2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:28.949806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58b3b2-c69f-4130-9750-31ba2bd2bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:28.950483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58b3b2-c69f-4130-9750-31ba2bd2bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:28.950735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58b3b2-c69f-4130-9750-31ba2bd2bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:28.951015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58b3b2-c69f-4130-9750-31ba2bd2bd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:28.958373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:28.969055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.002126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fb0ea-de8f-43bf-9a6a-301d7766c0c1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.045257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58b3b2-c69f-4130-9750-31ba2bd2bd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.045738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.046431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.046659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58b3b2-c69f-4130-9750-31ba2bd2bd85 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.046765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.046961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.047727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:29.048039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.049979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61302-8b4b-4a0b-bc38-a57490a90f3a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.062651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 323/634] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:29.064152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917df8c-5aa3-49c0-9a71-c87d93fbb20a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.064440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917df8c-5aa3-49c0-9a71-c87d93fbb20a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.064750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917df8c-5aa3-49c0-9a71-c87d93fbb20a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.066312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 324/635] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:29.067847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917df8c-5aa3-49c0-9a71-c87d93fbb20a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.181192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917df8c-5aa3-49c0-9a71-c87d93fbb20a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.197540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 312/636] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:29.199440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.200662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.200950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.219980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.225821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:29.227941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:29.230411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.231279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.231565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.231869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.240530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.242062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:29.256884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:29.257897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:29.258857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 325/637] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:29.259463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.292151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.331504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 313/638] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:29.338021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.400736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fc07-8ee7-4248-bbb8-a0feac084b43 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.447417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.448236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.448517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.448902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.461740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0144e-29a2-4c53-8de4-3d7bcae4dc0a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.464199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.465686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-96b3355e-21ef-4227-91bc-6160009ac27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:29.483456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:29.484632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:29.485553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:29.485553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:29.485553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:29.485553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:29.485553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 326/639] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:29.485869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473038-02f5-434f-8d58-fc9473125f24 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.486159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473038-02f5-434f-8d58-fc9473125f24 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.486516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473038-02f5-434f-8d58-fc9473125f24 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.488886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 327/640] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:29.493173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28473038-02f5-434f-8d58-fc9473125f24 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.505222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.505899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.506185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.506466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.507313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:29.507643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.509125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.528518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 314/641] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:29.533517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.541620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.568036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.602509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28473038-02f5-434f-8d58-fc9473125f24 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.640276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376877-161c-4e8b-9111-b86d19e1158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.640533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d78a-58ec-4e47-8ba5-205158f69a6d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.641080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376877-161c-4e8b-9111-b86d19e1158b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.641362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376877-161c-4e8b-9111-b86d19e1158b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.641634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376877-161c-4e8b-9111-b86d19e1158b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.653369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9376877-161c-4e8b-9111-b86d19e1158b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d9376877-161c-4e8b-9111-b86d19e1158b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:29.661476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:29.662514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:29.663372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 328/642] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:29.664847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.664847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.664847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.681817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.682246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:29.682484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.682769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.683050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.683414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:29.683804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:29.684118 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.685622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.704192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 315/643] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:29.704192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.772007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 329/644] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:29.773286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.810333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.819136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:29.829588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451d84-654d-434d-94ff-37e6ac9a4eee None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.875053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.875663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.875953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.876236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.891344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4adeed-c9ed-45d0-8407-88d52c9e1ac8 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:29.931830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:29.932505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:29.932791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:29.933063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:29.933841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:29.934152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.935653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:29.946332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 330/645] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:29.947240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:29.979918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:29.981411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.065986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.078138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2344c5-8385-4644-9f5d-562a060e716a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.103348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.119812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 316/646] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:30.119812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.120108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.120108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.120464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.120759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.130083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.131686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:30.149969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:30.150906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 331/647] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:30.152000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.228090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f543d8f-5063-4df0-96c4-9bfe894466fa None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.267075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.267499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea751ae-5665-4ff6-b47f-b5475dfd0e80 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.267970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.268260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.268542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.279826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:30.288166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:30.289131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:30.289979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 317/648] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:30.290672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.309568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.310375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.310660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.310940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.322375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.323955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:30.343882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:30.344890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:30.346341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:30.346341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:30.346341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:30.346341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:30.346341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 332/649] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:30.346634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.352482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.358380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.411956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429939-6a85-40f0-9927-5fb232df5aaf None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.449892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.450682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.450973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.451251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.462058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.463501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.464737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76709c93-ed48-41aa-8127-bf312c4acb42 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:30.480869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:30.482159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:30.483994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:30.483994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:30.483994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:30.483994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:30.483994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 318/650] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:30.483994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.508031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.508994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.509429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.509878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.510808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:30.511349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.512848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.525884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 333/651] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:30.531141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.595538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25467e7-c1b9-4c3a-ae2f-a710f6b93007 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.597120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.599891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.637523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b4ad-cd6a-4acc-b3d9-72aea006394b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.638232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.639063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.639363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.640442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.641304 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:30.641624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.643574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.659534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 319/652] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:30.659534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.675668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.676245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.676524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.676796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.677512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:30.677814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.679180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.691681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 334/653] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:30.692508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.777085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bbc08-8d3d-437d-9dad-19262b7c08bc None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.803635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0bfa-245f-4350-ab33-3fb469e4a32b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.815295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.815998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.816279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.816583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.817285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:30.817595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.818972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.831854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 320/654] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:30.832705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.837960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.850632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:30.851345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:30.851767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:30.852045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:30.852995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=87dd16048e5244f4adc3f5859d6ea8e9) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:30.853308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:30.854749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:30.860793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:30.862189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 335/655] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/role_assignments?user.id=87dd16048e5244f4adc3f5859d6ea8e9&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:30.863251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:30.982485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039e3d-f6c3-4f12-b726-5357f7735f1a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:30.996469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252ada-3d8e-476f-bd4d-995d9744bf0c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.029853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.030673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.030955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.031230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.042874 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.044852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.047169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.048667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.049254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.049741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.060320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.062097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:31.066598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:31.067497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:31.068832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:31.068832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:31.068832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:31.068832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:31.068832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 321/656] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:31.068832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:31.084115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:31.085819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 336/657] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:31.087458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.144797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.176587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.200594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827134-2c8e-4fbe-8ce5-fb65ef771359 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.206740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1e24-7932-47d0-8bfa-8e3fb8a230e8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.237621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.238330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.238611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.238885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.245841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.246167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.246828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.247110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.247307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.247420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.248153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:31.248464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.249830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.262509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 337/658] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:31.263334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6fe4340b-eeb0-435d-841c-b20011a177a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:31.270109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:31.271009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:31.271956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:31.277551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 322/659] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:31.277551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce06744-f537-46e9-ab02-703c57ad036a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.277551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce06744-f537-46e9-ab02-703c57ad036a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.277551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce06744-f537-46e9-ab02-703c57ad036a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.279757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 323/660] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:31.280715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce06744-f537-46e9-ab02-703c57ad036a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.386096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95557f-f0fe-4d19-9af5-257bc9d488c9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.399334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.419210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce06744-f537-46e9-ab02-703c57ad036a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.432445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.433440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.433929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.434248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.435563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:31.436144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.438423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.457884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.462547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 338/661] 10.222.0.25 () {56 vars in 1137 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:31.462691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.462691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.462691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.462976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.472144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.473602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.475493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-59f71bd5-090d-49b3-b53d-d335fa106ef3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:31.490665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:31.491675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:31.492675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 324/662] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:31.493351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.493420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.494156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.510964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:31.512184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:31.583743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa361ad-9486-4076-9ea7-43210d4c4018 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.595688 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 325/663] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:31.596833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.625864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.626528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.626810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.627663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.628452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:31.628760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.630223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.646958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 339/664] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:31.646958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.684767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.715098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef53b5-ffd2-4cc7-9b31-65b5dafe2b87 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.751437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.760488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.761146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.761431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.761712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.773842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd286430-a14f-4677-9cee-cb6d1ab1847c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:31.815086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:31.815872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:31.816083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:31.816362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:31.817227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:31.817531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.819050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.842324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 340/665] 10.222.0.25 () {56 vars in 1139 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:31.843194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.851993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:31.853808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:31.970400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:31.991655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 326/666] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:31.992729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:31.992995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26955d-c2e4-4df7-997c-9968b8307669 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.028199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.047859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.048672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.049503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.049782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.065554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:32.074977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:32.078093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:32.079354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:32.082907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 341/667] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:32.084086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.128596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b465-27c7-41cc-ad36-cd599eb82bea None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.169520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.170184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.170472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.170752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.171596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=e01bb2821eec4234917742be62b441ac) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:32.171942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.173403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.182430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 327/668] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:31 2022] GET /identity/v3/role_assignments?user.id=e01bb2821eec4234917742be62b441ac&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:32.183590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.228187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390ed96-af1d-4cc6-bf67-ce9331a5e20d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.276973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.278323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.278850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.279328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.305766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.348047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32421abe-f677-49bb-b1bb-e1713561fa51 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.352073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.372834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.374622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.391699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.393289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.393730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.394017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.406285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.407798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:32.433438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:32.434398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:32.435305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:32.435305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:32.435305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:32.435305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:32.435305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 328/669] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:32.436043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.510282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 342/670] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:32.512426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.576233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.578208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb004-b171-4354-88ec-3f080d13bdeb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.616907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.617983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.618455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.619024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.620177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:32.620689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.622288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.632844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 329/671] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:32.634007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.647660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9656a-d325-4e84-96d9-55647176b2f4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.653634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.696420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.697654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.699062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.699523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.700548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:32.701056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.702780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.721976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 343/672] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:32.723136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.781215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ea286-1bac-4272-aac9-e36723a3b788 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.833769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.834500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.834783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.835062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.848596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.850216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.860846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac9fc-6d84-4899-8adb-c018989a330f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:32.864545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:32.872428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:32.873661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:32.874798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:32.874798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:32.874798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:32.874798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:32.874798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 330/673] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:32.875123 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.909846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:32.911012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:32.911464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:32.911916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:32.924920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:32.926748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:32.943443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:32.948772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:32.949860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:32.950826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:32.950826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:32.950826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:32.950826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:32.957576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 344/674] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:32.958826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:32.990889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c00257-a680-447e-97bb-7615a993b960 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.028705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.029504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.029787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.030062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.037528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.038998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:33.054841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:33.055832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:33.056881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:33.057395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 331/675] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:33.058092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.085301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866184d-e545-4ba5-972f-28b85831e2ae None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.132338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.133458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.133958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.134444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.135427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.136042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.137717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.152946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 345/676] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.154247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.176621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:33.177037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af47d-5b50-42b5-b90e-96be1db821f8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.202536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:33.224344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fe11f-1324-4097-8411-07115787b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.225035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fe11f-1324-4097-8411-07115787b075 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.225319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fe11f-1324-4097-8411-07115787b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.225600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fe11f-1324-4097-8411-07115787b075 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.226344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fe11f-1324-4097-8411-07115787b075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.226654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fe11f-1324-4097-8411-07115787b075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.228235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fe11f-1324-4097-8411-07115787b075 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.246679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 332/677] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.246679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fe11f-1324-4097-8411-07115787b075 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.287893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1de5-b046-4d36-8315-59878d9e5a3b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.326837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.327875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.328526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.329018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.330159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.330688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.332541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.349251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 346/678] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.350475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.357411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fe11f-1324-4097-8411-07115787b075 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.394483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.395239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.395530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.395836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.403570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.405068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:33.420157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:33.421079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 333/679] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:33.425243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.441468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:33.467484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:33.471099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017508-357f-432c-92c7-cf91fd8d5d43 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.510489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.511721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.512016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.512293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.520702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.522165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a372005f-891f-4093-85ce-14fd17906fc6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:33.536939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:33.537913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:33.538878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 347/680] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:33.540184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16185036-e90a-45c4-915a-b7def2e9e78c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.540184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16185036-e90a-45c4-915a-b7def2e9e78c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.540356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16185036-e90a-45c4-915a-b7def2e9e78c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.543865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 348/681] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:33.543865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16185036-e90a-45c4-915a-b7def2e9e78c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.544089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe7b9b-6b2c-4c8a-9fc5-c3511c8c93cb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.582191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.582959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.583248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.584187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.584398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=e9abdf0cdb63429d926f201034fb72ed) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.584709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.586152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.599743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 334/682] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/role_assignments?user.id=e9abdf0cdb63429d926f201034fb72ed&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.599743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.685788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16185036-e90a-45c4-915a-b7def2e9e78c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.712015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562687-7c47-4cae-9c28-3cd2b3acd54b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.713992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:33.735427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.736282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.736631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.736975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.737867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.738785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.740718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205054-0b75-4fa3-b126-e15bbeb23c31 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.745048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:33.754051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.754731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.755016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.755298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.756250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.756585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.758130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.760530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 349/683] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.762853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.763283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.763713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.782756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 335/684] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.784368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.785706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:33.787432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:33.897676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 350/685] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:33.899786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:33.922482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106be9a6-6604-4844-8386-f8ac8d7ec7a8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:33.972192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:33.972963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:33.973244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:33.973525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:33.974361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=6ae2e3c1b1b04ce7950a81c33308d560) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:33.974679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:33.976374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:33.983062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 336/686] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/role_assignments?user.id=6ae2e3c1b1b04ce7950a81c33308d560&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:33.984217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:34.026587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:34.086583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0ce6b-ae70-4c51-8f13-79953391e7f2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:34.139241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:34.158953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:34.159553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.159871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.160148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.180415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3509576-8b33-4dbd-87de-c50fffad65ad None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:34.244264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:34.245122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.245533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.245821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.263658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:34.275193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:34.276198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:34.277075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 337/687] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:34.284157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:34.305798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:34.307312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:34.410331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:34.436321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7dd79-53cc-4a63-bfd0-2bf895a8ebf9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:34.465098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 351/688] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 16:19:34.471465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:34.492030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:34.493087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.493570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.494144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.495457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:34.496051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:34.497795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:34.509405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 338/689] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:34.519750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:34.524521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:34.666663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0a2b8-f828-400f-b465-9c4535e9de3f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:34.688029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00ae0-c588-41f6-ab8c-0201058f6881 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:34.725803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:34.726761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.727043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.727437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.741099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:34.742766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:34.754809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:34.756166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.756655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.757141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-0448b162-f6f0-4a4a-9d9b-f773f4a17e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:34.764571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:34.765602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:34.766573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:34.766573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:34.766573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:34.766573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:34.766573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 352/690] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:34.771639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea844552-b1cf-4ba9-b9de-c7e0c73fb365 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.771639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea844552-b1cf-4ba9-b9de-c7e0c73fb365 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.771639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea844552-b1cf-4ba9-b9de-c7e0c73fb365 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.775499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 353/691] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:34.776993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:34.777281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:34.777981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:34.785975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:34.788678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:34.798647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:34.800776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:34.801623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:34.832311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:34.834384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:34.836956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:34.836956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:34.836956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:34.836956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:34.844332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 339/692] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:34.846615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:34.874720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 354/693] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:34.875610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:34.904003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:34.986200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1b1cf-de86-4626-9de6-dd7c789e6612 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.018606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bba56-43a0-4de0-b474-7a157ee300a9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.029835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.030792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.031080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.031359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.032451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:35.032836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.034995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.057161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 340/694] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:35.058554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.061485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.062294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.062579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.062854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.063790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:35.064110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.065822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.085859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 355/695] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:35.086993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.144001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:35.172465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:35.200463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9abdd-5d50-4009-8183-71df1e2d5a7f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.214692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a4074-5062-4489-8ff8-7a1d0f70723f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.244770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.245640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.246025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.246312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.247111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.248657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.256254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.257214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.257536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.257941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:35.265857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:35.268772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:35.271051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:35.273050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.273218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 341/696] 10.222.0.25 () {56 vars in 1129 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:35.273218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.275734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:35.294126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:35.295393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:35.296512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:35.298965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 356/697] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:35.300159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.401489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89587409-cf21-4db8-bce1-621e5a4b772d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.420665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048311bb-899f-4b5e-93ef-b7a27fae4d04 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.428916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:35.445578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.446671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.446793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.447068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.454654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:35.460111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.461780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.464219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.464895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.465224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.465501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.466257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:35.466525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.467980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.478380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 357/698] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:35.479173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:35.481784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:35.482973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:35.484607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:35.487194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 342/699] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:35.488240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.652875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b951-6824-431d-b791-bbd1363b9a78 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.653727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77a57-c0d4-4a28-a2b2-799250490379 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.694437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.695141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.695430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.695771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.696352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.696598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:35.696914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.697556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.697992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.698433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.698658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.699575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:35.700413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.702334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.710013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 343/700] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:35.711077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.722529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 358/701] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:35.734216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.796555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:35.859748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae268c8-cd86-4ace-ba13-60a782a7d864 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:35.862663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:35.907064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:35.908147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:35.908588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:35.909040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:35.910151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:35.910659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:35.912557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:35.935526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 344/702] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:35.942785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:35.988386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a7864-cc2f-48fd-9c37-9ea1cacc2f79 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:36.066500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:36.067244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.067438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.067747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.068591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=d270113b79534fadbb15eb81eb547a5c) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:36.069078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:36.070729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864a57-4f0b-4916-8bef-cf98de1f3c70 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:36.077905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 359/703] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/role_assignments?user.id=d270113b79534fadbb15eb81eb547a5c&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:36.122453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe612-7100-44e7-bb74-a32b5eb13c5c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:36.126053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:36.295840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:36.297541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.298061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.298563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.392500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:36.394690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:36.461667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee711-b46d-4603-96ed-933c78e576fb None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.462182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee711-b46d-4603-96ed-933c78e576fb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.462261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee711-b46d-4603-96ed-933c78e576fb None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.463642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 360/704] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:36.472943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.473542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.474049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.507397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:36.510149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:36.530517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 345/705] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:19:36.542972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:36.547837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:36.612236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 361/706] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:36.650791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:36.672553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866909db-43f8-43b2-9d04-b5291537dbd6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:36.711299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:36.716791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:36.717596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.718190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.718471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.732224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:36.734185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:36.758346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:36.759329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:36.760273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:36.760273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:36.760273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:36.760273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:36.762303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 346/707] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:36.768303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:36.781695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6219-8456-46f1-b666-f435e3aa728c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:36.826794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:36.827699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.827993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.828269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.828842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:36.842851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:36.844606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d60acdd6-efe0-4d74-9b06-ff64206de653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:36.868057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:36.869257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:36.870307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:36.870307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:36.870307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:36.870307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:36.870307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 362/708] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:36.874987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc45cd3-73a0-4a73-850e-86e2c57462f6 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.874987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc45cd3-73a0-4a73-850e-86e2c57462f6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.874987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc45cd3-73a0-4a73-850e-86e2c57462f6 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.874987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 363/709] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:36.875938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc45cd3-73a0-4a73-850e-86e2c57462f6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:36.885607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e28c1e-caf1-4bc8-baac-58d2f9c18ba9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:36.934694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:36.935362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.935659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.935951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.936674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:36.936980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:36.938353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55697ed4-0bb6-4526-ad61-49faf10fe0de None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:36.956948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 347/710] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:36.958366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:36.958659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:36.958934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:36.977110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:36.978285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:37.005422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:37.011794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc45cd3-73a0-4a73-850e-86e2c57462f6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.051309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.052048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.052327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.052599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.053361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:37.053670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.055046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.061765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 348/711] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:37.063019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.067534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 364/712] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:37.072752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.119161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:37.180620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a4f8-93f6-41df-a2e8-9b27d5fa6483 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.186080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51f5a4-b899-45ba-9c5c-27cfe5a903c2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.218025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.218917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.219373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.219823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.220693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.222321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.233412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.234530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.235032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.235464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.245441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.247196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.252718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 365/713] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:19:37 2022] POST /identity/v3/users => generated 254 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:19:37.253793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:37.265570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:37.266782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:37.268602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:37.271432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 349/714] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:37.279245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.288608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:37.465708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2993a5-1df0-4555-80a3-f3c032962d16 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.491591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9062-734c-4c59-aca7-6bc53b1ec662 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.503671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:37.521276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.522092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.522370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.522643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] PATH_INFO: `/v3/services/network` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.523299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.524734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:37.539577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:37.540631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:37.541675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 366/715] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:37 2022] GET /identity/v3/services/network => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:37.543205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.544450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.544450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.544450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.545968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:37.546290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.546731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.547889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.561365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 350/716] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:37.570216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.648868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:37.682681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de3c7-65c5-40f7-812c-91f3bd88af74 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.706313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cab6b-6704-458b-acd9-60159e2056ee None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.737999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.739207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.739960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.740421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.742017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] RBAC: Adding query filter params (name=network) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:37.742546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.745081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.748667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.749398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.750084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.750984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=87dd16048e5244f4adc3f5859d6ea8e9) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:37.751357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.752315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 367/717] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:19:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:37.753833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc0ecd-350d-41d8-adc8-fef811c28e54 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.757898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:37.768080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 351/718] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:37 2022] GET /identity/v3/role_assignments?user.id=87dd16048e5244f4adc3f5859d6ea8e9&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:37.881654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde340-dc6a-4727-96e5-786473f02861 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:37.922221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:37.922947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:37.923233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:37.923514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:37.924828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] RBAC: Adding query filter params (type=network) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:37.925139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:37.926561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d350476-148e-4af6-8379-ebd389e8ab50 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:37.933654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 368/719] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:19:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:38.538059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca32a5-5a03-472a-8cd1-e6a2c86db4b2 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:38.539088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca32a5-5a03-472a-8cd1-e6a2c86db4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:38.539604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca32a5-5a03-472a-8cd1-e6a2c86db4b2 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:38.541716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 352/720] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:38.547341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23247-aaf1-49d7-9b63-bfc6c2aacd93 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:38.548184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23247-aaf1-49d7-9b63-bfc6c2aacd93 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:38.548698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23247-aaf1-49d7-9b63-bfc6c2aacd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:38.561211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:38.568359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-72b23247-aaf1-49d7-9b63-bfc6c2aacd93 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:38.569833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-72b23247-aaf1-49d7-9b63-bfc6c2aacd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:38.647746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 369/721] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:38.667663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca32a5-5a03-472a-8cd1-e6a2c86db4b2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:38.703990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:38.780829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca32a5-5a03-472a-8cd1-e6a2c86db4b2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:38.816572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e8454-a944-45fe-957c-c960d0850e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:38.817557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e8454-a944-45fe-957c-c960d0850e65 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:38.818064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e8454-a944-45fe-957c-c960d0850e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:38.818543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e8454-a944-45fe-957c-c960d0850e65 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:38.819476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e8454-a944-45fe-957c-c960d0850e65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:38.821146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e8454-a944-45fe-957c-c960d0850e65 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:38.843858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 353/722] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:19:38 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:39.087934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000c7e7-7fc3-4db3-8c63-10b198d00f9a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:39.088604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000c7e7-7fc3-4db3-8c63-10b198d00f9a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:39.089103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000c7e7-7fc3-4db3-8c63-10b198d00f9a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:39.090965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 370/723] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:39.096059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:39.096623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:39.097107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:39.115117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:39.116644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:39.201334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 354/724] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:39.224754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000c7e7-7fc3-4db3-8c63-10b198d00f9a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:39.350823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000c7e7-7fc3-4db3-8c63-10b198d00f9a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:39.397500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:39.398332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:39.398609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:39.398983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:39.411970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:39.416989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:39.425791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:39.426757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:39.427649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:39.431992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 371/725] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:39.438825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:39.484002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:39.565832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659185-f653-4534-a53d-fddf3d4166af None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:39.601863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:39.602541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:39.602823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:39.603102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:39.603883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:39.604195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:39.605592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:39.615586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 355/726] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:39.620999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:39.922445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04c8a-9bea-4515-9f52-b35e6e207290 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:39.969793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:39.971632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:39.972141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:39.972622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:39.986955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:39.988761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:40.009779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:40.010724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:40.011609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:40.011609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:40.011609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:40.011609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:40.013905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 372/727] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:40.021464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:40.133859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:40.167660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3abc0-9d1c-4760-9fe3-ec401099d361 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:40.218554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:40.219701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.220198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.220722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.221715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:40.222267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:40.223896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:40.243303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 356/728] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:40.248733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:40.316057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:40.388960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51fe61-50e7-48e3-8dc2-79f8a5e4ddd9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:40.447112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:40.448337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.448828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.449299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.463786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:40.465581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-6d3ed03e-52bb-48cc-b842-67fd0bb189ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:40.487593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:40.488681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:40.489781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:40.492675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 373/729] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:40.498039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:40.598201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2f3f-a233-400f-ab4f-a85e012157a1 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.598547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2f3f-a233-400f-ab4f-a85e012157a1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.598755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2f3f-a233-400f-ab4f-a85e012157a1 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.600428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 374/730] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:40.605923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d7f-b9e1-42ae-a9f0-8e79db264e28 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.606245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d7f-b9e1-42ae-a9f0-8e79db264e28 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.606457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d7f-b9e1-42ae-a9f0-8e79db264e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.624849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2f1e6d7f-b9e1-42ae-a9f0-8e79db264e28 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:40.626035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2f1e6d7f-b9e1-42ae-a9f0-8e79db264e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:40.651268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aeab0-e369-4996-8d0d-d898456741cc None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:40.699335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:40.700846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.701130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.701409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.702265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:40.702576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:40.705227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:40.728954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:40.758428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 357/731] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 19 16:19:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:40.764529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:40.774360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 375/732] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 16:19:40.776072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7388-32bf-4066-a74c-5aeb8ea7aec8 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.776586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7388-32bf-4066-a74c-5aeb8ea7aec8 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.777058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7388-32bf-4066-a74c-5aeb8ea7aec8 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.779240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 376/733] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:40.785646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.786245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.786722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:40.814463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:40.815712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:40.850395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:40.902887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 377/734] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:40.910364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:40.919662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1089719-3e6e-4f75-b07d-75eb901d6648 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:40.960392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881bb67-a237-4abb-868a-7a9e56227719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:40.961696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881bb67-a237-4abb-868a-7a9e56227719 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:40.962177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881bb67-a237-4abb-868a-7a9e56227719 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:40.962778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881bb67-a237-4abb-868a-7a9e56227719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.046586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.052169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6233ab-a885-41a6-88ab-3e291a9d2aa3 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.054010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881bb67-a237-4abb-868a-7a9e56227719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.055469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881bb67-a237-4abb-868a-7a9e56227719 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.089761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.090952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.091493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.091884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.106785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:41.120905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:41.121921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:41.122782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:41.123436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 378/735] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:41.124422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.159185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.174887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 358/736] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 16:19:41.174887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759260c4-a90b-459e-8486-e24262956855 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.174887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759260c4-a90b-459e-8486-e24262956855 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.174887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759260c4-a90b-459e-8486-e24262956855 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.174887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 359/737] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:41.174887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759260c4-a90b-459e-8486-e24262956855 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.249546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6db8e-898c-4874-bb37-56dac99f9820 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.292086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.301309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.302220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.302539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.302886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.303536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759260c4-a90b-459e-8486-e24262956855 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.314735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:41.322563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:41.323684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:41.324546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 379/738] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:41.325248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.348913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.349638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.349892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.350172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.350945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:41.351259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.352792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f081c6-731e-40dc-8119-8f301cb3e95f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.363051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 360/739] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:41.365022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.365792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.366257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.386368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:41.389114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:41.463403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.472002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 361/740] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 16:19:41.472002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.490689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390756-721e-4572-b17f-4b7bacee3a2c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.537027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.537736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.538020 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.538451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.550848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.552352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.562652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:41.570203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:41.571279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:41.572376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:41.572376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:41.572376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:41.572376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:41.572376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 380/741] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:41.576496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.578932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bd385-e6aa-4f3f-8dc5-4a3b1733b3f5 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.615383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.616101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.616387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.616665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.617421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:41.617734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.619117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.629058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 362/742] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:41.632952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.681439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfa95d-31bd-4a9e-ac72-9310b9a4d5d3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.715061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.715869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.716154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.716429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.724968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.727800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.729568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.738741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd145-c9c3-4a15-a60e-5f66935bec8e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:41.746182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:41.747206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:41.748174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:41.748174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:41.748174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:41.748174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:41.748174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 381/743] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:41.748453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.774069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.774725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.775007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.775281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.776025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.777387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.790178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 363/744] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:19:41 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:41.790963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.804310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:41.873760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26ea6-a7b4-480a-b6b1-7f401e609f52 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.915658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bd62c-2191-44fb-9b8b-0874acfc1903 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:41.922048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.922726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.923074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.923930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.924665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:41.924977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.926415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b748-ec3f-4c98-b0a2-9339d58b09ca None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.939871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 382/745] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:41.942079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0256d0a-99c3-4bc7-b417-e40a809a6a50 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.942365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0256d0a-99c3-4bc7-b417-e40a809a6a50 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.942646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0256d0a-99c3-4bc7-b417-e40a809a6a50 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.944622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 383/746] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:41.945583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0256d0a-99c3-4bc7-b417-e40a809a6a50 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:41.957388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:41.958627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:41.959116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:41.959591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:41.971740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:41.973991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:41.991586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:41.992529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:41.993519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:41.993519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:41.993519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:41.993519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:41.993519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 364/747] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:41.994090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.015551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.057599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.078190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0256d0a-99c3-4bc7-b417-e40a809a6a50 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.112557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bafa6-c20d-4003-a35a-41910411d53d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.119381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.120081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.120362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.120635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.121775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:42.122084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.123463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561a6fb-aa98-44ab-9219-9b8f65e45f6e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.136579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 384/748] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:42.137857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.138159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.138435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.155385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:42.156527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.156656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:42.157295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.157574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.157914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.166048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.167504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:42.182289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:42.183217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:42.184150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 365/749] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:42.184637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.241207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 385/750] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:42.242427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.295029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.298346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956321-6ac0-4bf2-b5c9-008106500737 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.325507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.348912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.349581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.349859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.350133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.350910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:42.351219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.352627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.364937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 366/751] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:42.365568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.370268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0c48b-76ab-440b-8a7a-22918380d9d0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.405381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.406175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.406459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.406737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.414782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.416282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:42.431508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:42.432510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 386/752] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:42.433479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.472561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034e67-6f46-4da5-8d61-4185ac89d7e8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.517180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.518337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.518817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.519298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.520769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:42.521305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.523914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.537298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.541502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 367/753] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:42.541814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d954-063c-41e2-a50e-2e3ab2f98171 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.542335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.579787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.580501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.580786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.581062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.581714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.583097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.591683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:42.599790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:42.600775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:42.601645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 387/754] 10.222.0.25 () {56 vars in 1129 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:42.602510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.662629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5d65d-d551-491c-84c5-fc86fe2650f7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.705272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.706087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.706374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.706656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.714526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.716015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.723065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73954-270c-443f-9349-d662769bcbd0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:42.731931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:42.733036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:42.734023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 368/755] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:42.734624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.772996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.773896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.774287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.774670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.775857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:42.776279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.778537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.800803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 388/756] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:42.800803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.819700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.847039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:42.851835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85fa4-1fef-45c9-9d5d-d385ac718e7e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.897047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.897849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.898135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.898412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.899258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=d270113b79534fadbb15eb81eb547a5c) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:42.899647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.901365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.908914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 369/757] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/role_assignments?user.id=d270113b79534fadbb15eb81eb547a5c&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:42.909720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:42.921765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96c39e-f7a0-474d-9638-a057160ff928 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:42.963668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:42.964398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:42.964684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:42.964961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:42.965678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:42.965989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:42.967495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:42.978025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 389/758] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:42.979031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.029902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91835812-6f66-4d0f-8f81-2b4535a4cb92 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.067465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.068199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.068489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.068775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.069643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:43.069963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.071564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.071799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.091769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 370/759] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:43.092648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.096006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51b93f-1ddd-418d-a3f5-0c37a06aaca4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.115712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.134330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.135125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.135405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.135773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.146797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.148356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:43.168000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:43.169117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:43.170059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:43.170059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:43.170059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:43.170059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:43.170059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 390/760] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:43.170059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.218544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939de46-2a72-4a0d-81d4-d062c7514389 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.264251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.265124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.265415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.265941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.267059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:43.267963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.269850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.276914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 371/761] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:43.278035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.282022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da98d-4b2f-4095-86e5-2b876287d9d9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.325467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.326208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.326558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.326900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.332511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.391947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.413548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477335d7-d2c9-4bc7-a796-ee8b0dde9248 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.419652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.421266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.459198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.460434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.460434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.460644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.461524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:43.461893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.463349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.480578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 372/762] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:43.481745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.533679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 391/763] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:19:43.534822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.577912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.629504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb58-2201-4676-a308-ddb8d041dd73 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.651040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3c590-d8ef-4471-8b5f-370a587657d1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.675393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.676176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.676793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.677142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.678427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] RBAC: Adding query filter params (interface=public, service_id=3051359f6b964e36aeb5a4eafe72143c, region_id=RegionOne) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:43.678814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.680803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.690125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.691270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.691764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.692225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.695691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 373/764] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/endpoints?service_id=3051359f6b964e36aeb5a4eafe72143c&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:43.697083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.701389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.703204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.710326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:43.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:43.719730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:43.721174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:43.723899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 392/765] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:43.725432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.830668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31ee21-6764-4f72-a9f6-ceb6115f3e5e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.848182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:43.856677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53fda7-5bff-4800-a2c2-011b924aa227 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:43.872426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.874001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.874288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.874561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.887654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.889127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:43.909125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:43.910067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:43.911048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:43.911048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:43.911048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:43.911048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:43.915525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 374/766] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:43.916533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:43.917444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:43.917926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:43.918297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:43.918572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:43.919505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:43.921179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:43.928126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 393/767] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:43.929190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.039179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:44.069266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8cd00-e27f-41ca-8594-09cebf6d276c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.095895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cab7b-d35e-4a99-862c-125352b5cf66 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.108988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.110106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.110607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.111741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.112744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:44.113316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.114968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9170fa-db47-4993-a9ed-782f5ef5b0fd None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.129238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 394/768] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:44.131023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952382e-484e-409b-91ee-5dccc2f685f4 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.131527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952382e-484e-409b-91ee-5dccc2f685f4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.132064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952382e-484e-409b-91ee-5dccc2f685f4 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.133972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 395/769] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:44.135256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952382e-484e-409b-91ee-5dccc2f685f4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.141700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.142938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.143222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.143499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.144381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:44.144692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.146224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9bcac-4141-4fc9-8f9f-b65e0f91630f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.161267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 375/770] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:44.166357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.166357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.166357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.170799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:44.182858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:44.184104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:44.265296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 376/771] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:44.266376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.282215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952382e-484e-409b-91ee-5dccc2f685f4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.321550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.322346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.322714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.322992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.323444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:44.331260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.332953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:44.348122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:44.349249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:44.350322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 396/772] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:44.350813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.377446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17020d-f78f-4893-9b88-c76596b0c2ee None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.413309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.414144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.414425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.414802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/87dd16048e5244f4adc3f5859d6ea8e9/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.416848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=87dd16048e5244f4adc3f5859d6ea8e9, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.418391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.435782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 377/773] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:44 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/87dd16048e5244f4adc3f5859d6ea8e9/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:44.436945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.467992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:44.499853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af326-e703-413d-9ca7-c7a630963de4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.553122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.553918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.554197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.555212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.555951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.557460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.563450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e816be-c9b6-4702-99ef-2267e838ce7a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:44.570693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:44.571788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:44.572632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 397/774] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:44 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:44.580525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:44.581284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.608892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.609917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.610947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.611423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.612477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:44.613394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.615198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.630657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 378/775] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:44.637946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.775344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7911-1498-44fd-9032-03551d25b2f0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.809343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d87e-f50e-4111-832c-12c08157b31c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:44.812511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.813415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.814427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.814952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.815899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] RBAC: Adding query filter params (name=network) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:44.816406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.817993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.823481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 398/776] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:19:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:44.831886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:44.848313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:44.866443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:44.867113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:44.867392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:44.867688 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:44.868533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=4906e8d75de84c509617bc354ed860c5) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:44.868842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:44.870301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:44.884494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 379/777] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:44 2022] GET /identity/v3/role_assignments?user.id=4906e8d75de84c509617bc354ed860c5&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:44.990224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f7e3-2672-4884-9d5b-1692fd8db702 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:45.031630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:45.032245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.032530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.032837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:45.033568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:45.033876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:45.035311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:45.041369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 399/778] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:19:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:45.047485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:45.108229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:45.188294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b58a74-07dc-4e82-826d-f4a786848de6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:45.229478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:45.230169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.230454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.230720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:45.231660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] RBAC: Adding query filter params (interface=public, service_id=b849e79daba549988ac094c376e4a3fc, region_id=RegionOne) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:45.231986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:45.233492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b91e0-2e50-4408-8e58-c536d829c147 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:45.240844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 380/779] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:19:45 2022] GET /identity/v3/endpoints?service_id=b849e79daba549988ac094c376e4a3fc&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:45.246196 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:45.364982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:45.405373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4be9-9272-4346-b599-e5c0954e67bf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:45.422057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73607f4-c7e0-47a6-ae08-8e970d6d5172 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.422423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73607f4-c7e0-47a6-ae08-8e970d6d5172 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.422625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73607f4-c7e0-47a6-ae08-8e970d6d5172 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:45.426024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 381/780] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:45.430545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.430834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.431114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:45.454783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:45.456030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:45.474546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:45.475238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.475525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.475850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:45.476608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:45.478049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:45.491679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 400/781] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:19:45 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:45.563813 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 382/782] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:19:45.582303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:45.719807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1d65-711d-4a2b-b6c1-f7d37d52014e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:45.758068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:45.758880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.759164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.759439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:45.762469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:45.772369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:45.780548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:45.781958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:45.783390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 401/783] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:45.788801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:45.842357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:45.954384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87facc1-92f7-4735-b107-6e8e65b0e96f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:45.998324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:45.998922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:45.999209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:45.999488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.000274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:46.000585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:46.002532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:46.016108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 383/784] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:46.022235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:46.163416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e88f-d131-41d8-b6b1-445881fe0f2c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:46.207453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:46.208680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:46.209195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:46.209695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.221842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:46.223666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:46.249528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:46.250469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:46.251953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:46.251953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:46.251953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:46.251953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:46.254242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 402/785] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:46.260717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:46.404800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:46.415676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785f3d-d552-4924-911e-77842af588a3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:46.467224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:46.467926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:46.468216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:46.468494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.469290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:46.469601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:46.471072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:46.490868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 384/786] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:46.496585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:46.572070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:46.633116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380207-c034-4079-80cb-d33ca93cf287 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:46.676980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:46.677846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:46.678132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:46.678487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.687958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:46.690096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-fdd6e9c7-8838-4bbe-bc83-a9784d0013ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:46.717677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:46.718687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:46.719660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 403/787] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:46.725416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:46.875419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2bf2-1247-424c-a156-7108c64ecdab None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:46.875948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2bf2-1247-424c-a156-7108c64ecdab None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:46.875948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2bf2-1247-424c-a156-7108c64ecdab None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.877605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 404/788] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:19:46.882889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:46.883296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:46.883721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd44817-fd3d-46f6-b81b-f2b66a86a091 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:46.883841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.916878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:46.918426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:46.992338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:46.993114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:46.993438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:46.993583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:46.994411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:46.994729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:46.996230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:46.999413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 405/789] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:47.026745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 385/790] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 19 16:19:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:47.030350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.034054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.049340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:47.147739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:47.161971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147529f-b2f1-4c1d-8cb0-e7f927d01cf4 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:47.202495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:47.203312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.203600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.203906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.217614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:47.219238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:47.240099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:47.241112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:47.242264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:47.242264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:47.242264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:47.242264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:47.242264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 386/791] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:47.247157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.315781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3c07-1c57-415f-925d-b6c3b544e16b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:47.319485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:47.367106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9fa1-3cc2-4e8b-b5b3-95ac8dd4a056 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:47.406433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:47.407035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.407320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.408182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.408944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:47.409254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:47.410665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:47.423849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 387/792] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:47.429590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.436810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:47.437653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.437935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.438208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.438922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:47.446010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:47.471601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:47.473021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 16:19:47.473881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:47.480654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 406/793] 10.222.0.25 () {56 vars in 1129 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:47.481651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.580541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d196e-2d27-4748-880c-ed12b55df9f2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:47.601931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:47.618326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:47.619221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.619567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.619933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.628905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:47.630531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-fe45b28d-a638-4341-b0ee-b5b21ee05559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:47.646583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:47.647528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:47.648458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:47.652996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 388/794] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:47.654428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c37f-ec9b-42df-9dba-65d68134ea9f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.654716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c37f-ec9b-42df-9dba-65d68134ea9f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.654996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c37f-ec9b-42df-9dba-65d68134ea9f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.657049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 389/795] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:47.657969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c37f-ec9b-42df-9dba-65d68134ea9f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.663151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe490-e068-4663-8a43-d28af69368b5 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:47.665324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:47.725303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:47.726311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.726603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.726886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.727938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:47.728254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:47.730252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903429e-77fb-4ced-8ac5-fed59eb77076 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:47.739713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 407/796] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:47.741237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.741523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.741802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.766714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:47.769030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:47.798639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c37f-ec9b-42df-9dba-65d68134ea9f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:47.859553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:47.859917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 408/797] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:47.860407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:47.860582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.861290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:47.861472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:47.862317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:47.862634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:47.864324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:47.883100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 390/798] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:47.884613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:47.934398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:47.991395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.000858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278494-4cf0-4c05-ab2a-5ee5f2a78137 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.013317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8de4cb-feb1-4d54-b725-771a3ff38635 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.045381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.046351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.046790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.047213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.048115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:48.049125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.050672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:48.050792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a75c6b-06d8-4779-853a-564c60d40d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.051596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a75c6b-06d8-4779-853a-564c60d40d96 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.051909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a75c6b-06d8-4779-853a-564c60d40d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.052185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a75c6b-06d8-4779-853a-564c60d40d96 None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/d270113b79534fadbb15eb81eb547a5c/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.054214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a75c6b-06d8-4779-853a-564c60d40d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=d270113b79534fadbb15eb81eb547a5c, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.055710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a75c6b-06d8-4779-853a-564c60d40d96 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:48.061901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 409/799] 10.222.0.25 () {56 vars in 1124 bytes} [Thu May 19 16:19:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:48.063143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.082223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 391/800] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:47 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/d270113b79534fadbb15eb81eb547a5c/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:19:48.082223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29db4-510d-43bb-8555-77f62a443ca6 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.082223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29db4-510d-43bb-8555-77f62a443ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.082223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29db4-510d-43bb-8555-77f62a443ca6 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.084954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 392/801] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:48.084954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29db4-510d-43bb-8555-77f62a443ca6 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.218549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79e679-8253-40fb-bc21-696f6cbc4578 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.258561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.264614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29db4-510d-43bb-8555-77f62a443ca6 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.284012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52e66-337d-4361-a47c-357e03a8cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.285370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52e66-337d-4361-a47c-357e03a8cf33 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.285730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52e66-337d-4361-a47c-357e03a8cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.286017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52e66-337d-4361-a47c-357e03a8cf33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.303046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52e66-337d-4361-a47c-357e03a8cf33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d0a52e66-337d-4361-a47c-357e03a8cf33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:48.312671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:48.313682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:48.315085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 410/802] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:48.316741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babf6b1-7fae-4fb2-958e-ac9cdd1ec5db None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.316741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babf6b1-7fae-4fb2-958e-ac9cdd1ec5db None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.316741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babf6b1-7fae-4fb2-958e-ac9cdd1ec5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.324753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.325712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.326000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.326279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.327033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.328978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:48.335441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8babf6b1-7fae-4fb2-958e-ac9cdd1ec5db None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:48.336687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8babf6b1-7fae-4fb2-958e-ac9cdd1ec5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:48.355936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.359775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 393/803] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:19:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:48.360621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.481364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 411/804] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:48.482690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc512d-e705-40e3-859c-3af7abe67f44 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.489843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc512d-e705-40e3-859c-3af7abe67f44 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.490257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc512d-e705-40e3-859c-3af7abe67f44 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.492380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 412/805] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:48.497947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.498262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.498506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.531824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:48.533118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:48.549696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e2c57-431b-40b9-85b2-6a1e20c87bd8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.603984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.604672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.604957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.605236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.606001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:48.606316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.607837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:48.620080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 394/806] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:48.620770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.621154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 413/807] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:48.627097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.660050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.714516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.741969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbba1c-ea04-482e-90e3-cd79e11c05a0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.747504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8544763-75a2-4dc8-92ff-f9bcdf55fc54 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.783058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.783981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.784317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.784597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.788212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.789046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.789334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.789614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.797645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.799945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:48.803192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:48.811585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:48.812622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 395/808] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:48.814673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:48.825972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:48.828214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:48.830393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:48.830393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:48.830393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:48.830393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:48.830393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 414/809] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:48.830393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:48.915206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.945816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a21e2-e96f-49b7-a6f9-9337bd111fb6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.952538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962bc9-9e9d-4ee0-9db7-cf6eaa7cd5eb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:48.982843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:48.988261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.989072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.989363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.989643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] PATH_INFO: `/v3/services/network` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.990312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.991736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:48.993039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:48.993895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:48.994276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:48.994753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:48.995696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:48.996105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:48.997644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:49.004724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:49.005977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:49.007829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 396/810] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:48 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:49.009971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.010065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 415/811] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:49.014647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.120768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f06b1b-601d-4e18-a5bc-824c4aec3085 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.125191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ac3d-fd8f-4f0f-b321-422d6930ba91 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.162108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.162788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.162939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.163112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.163332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.163762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.164093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:49.164251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.164382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.164546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.165329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] RBAC: Adding query filter params (name=network) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:49.165700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.165839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.167347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.172955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 416/812] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:49.174531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.186200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 397/813] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:49.187160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.191887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:49.242039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:49.295302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2a6a-bdec-437c-bd2c-4377f0317301 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.334287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582707-af59-44e6-b647-9c2eb323a202 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.334828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.335782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.336165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.336542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.349545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.351181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:49.370137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:49.371698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:49.373883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:49.373883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:49.373883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:49.373883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:49.373883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 417/814] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:49.374522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.381671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.382416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.382705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.382981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.383789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] RBAC: Adding query filter params (type=network) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:49.384096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.386177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.395714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 398/815] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:49.396649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.476257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:49.515432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d4a2e-3864-4ad2-ae63-dd7bc7c3533f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.519716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ac1cb-8568-4f77-b4b0-fc57bf0492c5 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.529017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:49.558339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.559216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.559504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.559875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.560896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:49.561209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.563350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.566851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.567828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.568230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.568609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.577858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.578072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 399/816] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:49.578834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.580381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:49.599119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:49.600736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:49.602930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 418/817] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:49.604369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.703841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22682e-e2c1-4fbc-8886-71b17177240f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.719252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4a866-5c1a-40e1-b7ae-e2a104b5aa59 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:49.732405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:49.743195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.743894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.744177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.744448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.745203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.746604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.761941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:49.762796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:49.763079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:49.763355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:49.771773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 400/818] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:19:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:49.772744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.776538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:49.778330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:49.805895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:49.808197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:49.814664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 419/819] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:49.819671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:49.881016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.007461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608351-dcc6-462c-a082-2df27aec3cc9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.039479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb91a0-a5a6-4af8-ad43-11dbd989a47c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.061452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.062138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.062420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.062697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.063539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:50.063910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.065535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.085850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.086661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.086948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.087218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.088380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 401/820] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:50.089249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:50.089567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.091032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.094440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.121317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 420/821] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 19 16:19:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:50.128786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.145921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.243588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d6f6c-030b-4d5d-9cb4-8965e16662df None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.252887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.276935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabc35-f058-4073-b55d-dd1f996b7355 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.293436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.294658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.295611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.296422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.323857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.324633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.325493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.325791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.340634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.343209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:50.367208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:50.368276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:50.369264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:50.369264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:50.369264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:50.369264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:50.371702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 421/822] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:50.374693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.386884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.388490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.441421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.536220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bbcb-692a-4a4c-8f0a-95efff505ac0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.537758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 402/823] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:19:50.542949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.580557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.581575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.582071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.582576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.583513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:50.584128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.586542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.590203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.607731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 422/824] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:50.611005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.692434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62fda-dcb3-4a35-a38f-67be5cec4722 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.741982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.742780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.743063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.743337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.747030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.756563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.758036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-ffcab57c-ab62-48cc-837e-158c76964728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:50.782948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:50.783958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:50.784878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:50.784878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:50.784878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:50.784878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:50.785559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690361a-efd6-44e6-a6fe-943ca97b4e7f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.787399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 403/825] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:50.790109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c420-abb3-48f8-baad-11f9aa550d29 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.790698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c420-abb3-48f8-baad-11f9aa550d29 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.791549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c420-abb3-48f8-baad-11f9aa550d29 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.793390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 404/826] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:50.794372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c420-abb3-48f8-baad-11f9aa550d29 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.834117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.834848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.835146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.835396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.844392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.845929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d95ddece-3eba-4fde-a9a7-ed27dd9a8725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:50.861483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:50.862666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:50.863637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 423/827] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:50.864286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.864577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.864855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.885626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:50.886836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:50.940027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c420-abb3-48f8-baad-11f9aa550d29 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:50.942998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:50.962737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 424/828] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:50.968558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:50.996122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:50.996791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:50.997079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:50.997358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:50.998088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:50.998402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:50.999811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4b941-f1c4-4a06-99b3-52e998631e3a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.012083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 405/829] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:51.013194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754f4f-a1f4-446e-a233-2f1389a9c27f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.013483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754f4f-a1f4-446e-a233-2f1389a9c27f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.013761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754f4f-a1f4-446e-a233-2f1389a9c27f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.015165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 406/830] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:51.015750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754f4f-a1f4-446e-a233-2f1389a9c27f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.068227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.080038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31857b7a-9b0f-40f9-8949-8b2713713f4e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.114703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.115306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.115593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.115903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.116693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:51.117005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.118463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.121657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754f4f-a1f4-446e-a233-2f1389a9c27f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.130823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 425/831] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:51.131685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.160508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bfca3-c52b-476b-bd39-d74a76a7f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.161308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bfca3-c52b-476b-bd39-d74a76a7f184 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.161596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bfca3-c52b-476b-bd39-d74a76a7f184 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.161874 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bfca3-c52b-476b-bd39-d74a76a7f184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.172449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bfca3-c52b-476b-bd39-d74a76a7f184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:51.178093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-5e1bfca3-c52b-476b-bd39-d74a76a7f184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:51.181120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:51.182334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:51.183186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 407/832] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:51.183930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.184193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.184516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.201414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:51.202609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:51.239428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2eed-20b2-40e9-9b00-ee52a9a8d76f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.273142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.273945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.274232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.274506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.279005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 408/833] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:51.279951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.281883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.283920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:51.299799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:51.300762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:51.301678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:51.303775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 426/834] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:51.304809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.321493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.383253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b1fc-1014-4bc0-8691-a60caf13a5a4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.406109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c383a-defb-47b8-a7f2-3a155a021345 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.414407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.418722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.419630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.419933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.420215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/4906e8d75de84c509617bc354ed860c5/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.436400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=4906e8d75de84c509617bc354ed860c5, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.437862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.444087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.444760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.445087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.445313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.446139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:51.446454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.447868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.450614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 409/835] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:19:51 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/4906e8d75de84c509617bc354ed860c5/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:19:51.451425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.459796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 427/836] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:51.461910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.570086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.586892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c822-bafc-4eab-ac0f-5daaeb86f1e0 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.587157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95122-8538-4836-8a1c-74f086290e8b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.629112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.629804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.630065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.630372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.631134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:51.631445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.632978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.636402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.637168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.637453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.637733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.638403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.639823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.650110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 428/837] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:51.650972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:51.655670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:51.656742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:51.658231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 410/838] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:51.659062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.681772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.760577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998821d-6679-4e0a-86ca-22cd359a11b6 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.761782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14595af5-6631-4d51-b187-0cbed77ac5c5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.798753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.799108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:51.799551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.799787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:51.799903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.800117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.800216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:51.800398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:51.801247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=87dd16048e5244f4adc3f5859d6ea8e9) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:51.801567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.803029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.810123 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 411/839] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/role_assignments?user.id=87dd16048e5244f4adc3f5859d6ea8e9&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:51.811027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.821573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:51.823088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:51.839408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:51.847279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:51.848342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:51.849263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:51.849263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:51.849263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:51.849263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:51.851795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 429/840] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:51.854271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:51.971290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7344dd-dc39-4617-a7c6-161333f68108 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:51.992023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:52.013361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3f6e7-c27a-4b64-b1db-3c528b5fe918 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:52.024511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.025186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.025467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.025736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.026446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:52.026753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.028421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.033981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 412/841] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:52.039421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:52.054924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.055644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.055993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.056274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.057532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:52.057532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.058738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.075230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 430/842] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:52.081879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:52.143941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:52.165243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b8c1-af0e-4d18-b3e1-423b11e9ab38 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:52.197046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f91a8-d911-4d64-bd19-6e7a3962db78 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:52.201872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.202894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.203327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.203768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.204684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:52.205232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.207501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.213159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 413/843] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:52.236065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.237017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.237372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.237720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.246958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.248626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.253749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:52.269124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:52.270138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:52.271103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 431/844] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:19:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:52.276976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:52.400714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b614-3208-4885-844d-d96dbe898e01 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:52.440482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.441451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.441734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.442011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.442851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:52.443162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.444643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.465188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 414/845] 10.222.0.25 () {56 vars in 1135 bytes} [Thu May 19 16:19:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:52.470876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:52.580077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032c34-ea58-42d9-80bb-5894e738ef7d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:52.617530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.618601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.619093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.619576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.692562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:52.695169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.696937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.805141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 432/846] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:19:52.811034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:52.814251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:52.917968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda42505-03c3-47a5-844e-3cf894958b93 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:52.954144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:52.955450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:52.955757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:52.956032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:52.970946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:52.972449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:52.991174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:52.992166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:52.993085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:52.993085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:52.993085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:52.993085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:52.993085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 415/847] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:52.999337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:53.106089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:53.109603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ec409-f2b6-46ed-94ec-10d57f8273b7 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:53.146387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:53.147053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:53.147333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:53.147608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:53.148358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:53.148667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:53.150064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:53.162927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 433/848] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:53.168220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:53.227720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:53.279459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821838e-342d-4592-a8d5-f27b7dabb4d0 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:53.315528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:53.316766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:53.317284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:53.317739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:53.325294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:53.327050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:53.342208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:53.343124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:53.344075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:53.346903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 416/849] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:53.355117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:53.462247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f27c3-92d8-4781-847b-73ef9b0cdcd6 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:53.498086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:53.498676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:53.498965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:53.499241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:53.500075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:53.500386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:53.502387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187b465-65f8-4ad8-b740-3c13282c7052 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:53.515560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 434/850] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:53.522131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:53.634778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767c87-24d5-4840-a98d-715f800e673c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:53.650243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:53.671128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:53.671825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:53.672110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:53.672385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:53.673267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=d270113b79534fadbb15eb81eb547a5c) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:53.673581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:53.675032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5245ba-9dac-452b-aaf8-c87fd4ceb73c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:53.681882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 417/851] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:53 2022] GET /identity/v3/role_assignments?user.id=d270113b79534fadbb15eb81eb547a5c&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:53.776923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097db723-1dde-4986-8833-506d4b4e9249 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:53.777104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097db723-1dde-4986-8833-506d4b4e9249 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:53.777675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097db723-1dde-4986-8833-506d4b4e9249 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:53.779540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 435/852] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:53.787307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:53.787680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:53.787931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:53.810532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:53.811776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:53.888395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 418/853] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:53.911449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097db723-1dde-4986-8833-506d4b4e9249 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:53.935905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.037860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097db723-1dde-4986-8833-506d4b4e9249 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.074566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.075366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.075738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.076018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.087157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:54.095216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:54.096269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:19:54.097128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:54.100672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 436/854] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:54.102929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.213138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29fbd-859a-4214-9f27-be7f332b141f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.223566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.249842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.250515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.250796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.251124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.251900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:54.252209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:54.253589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5600-2520-4362-a778-06cbaef6c3f8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:54.262616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 419/855] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:54.268106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.308827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65a034-acb4-41f5-a3fe-94a18003781d None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.309023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65a034-acb4-41f5-a3fe-94a18003781d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.309310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65a034-acb4-41f5-a3fe-94a18003781d None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.310975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 420/856] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:19:54.316876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.317170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.317450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.335844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:54.337285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:54.358141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.383527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569e330-dfcf-4098-a6da-2fc7fe9834fb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.424302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 421/857] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:19:54.427766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.427766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.427766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.427766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.440042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:54.441822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:54.446454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:54.460772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:54.461750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:54.462645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:54.462645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:54.462645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:54.462645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:54.462645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 437/858] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:54.468230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.560626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.566291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d8d7-a6e1-475f-b480-13b5fc0d6656 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.604414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a5fe3-fdb1-4dec-9a18-218df1bcd6e8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.605538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.606379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.606664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.606943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.608001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:54.611095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:54.627704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:54.628751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:19:54.629599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:54.632850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 422/859] 10.222.0.25 () {56 vars in 1132 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:54.642216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.647579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.653792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.654643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.655050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.655851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.657087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:54.658288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:54.659949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d09191-314e-4fbd-9c91-514649066776 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:54.675403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 438/860] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:54.678891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af1c6-1acc-4ab4-93af-8ff3ddf981e6 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.678891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af1c6-1acc-4ab4-93af-8ff3ddf981e6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.678891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af1c6-1acc-4ab4-93af-8ff3ddf981e6 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.678891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 439/861] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:54.683355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af1c6-1acc-4ab4-93af-8ff3ddf981e6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.759589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a98bc-3482-455e-b7da-19b78fb99c48 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.794204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af1c6-1acc-4ab4-93af-8ff3ddf981e6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:54.797913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.798585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.798871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.799149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.799902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:54.800216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:54.801613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872d8d6-6e1e-4867-9a09-b5cc968696ca None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:54.807259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 423/862] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:54.808828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.809312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.809775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.827837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:54.828968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:54.834981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:54.836039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:54.836324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:54.836600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:54.844663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:54.846722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:54.856013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:19:54.863018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:54.864060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 440/863] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:54.865022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.920340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 424/864] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:54.928577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:54.929658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:54.981308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a05fa-1f84-44ce-b660-7a5ce98525e3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:55.020539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76643df3-7760-4cec-849b-187a68146321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:55.021225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76643df3-7760-4cec-849b-187a68146321 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:55.021509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76643df3-7760-4cec-849b-187a68146321 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:55.021788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76643df3-7760-4cec-849b-187a68146321 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:55.022508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76643df3-7760-4cec-849b-187a68146321 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:55.022818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76643df3-7760-4cec-849b-187a68146321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:55.024248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76643df3-7760-4cec-849b-187a68146321 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:55.029549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 441/865] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:55.030314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76643df3-7760-4cec-849b-187a68146321 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:55.062144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78163764-1a28-4cef-ae82-bac6ece08f1a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:55.105818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:55.106877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:55.107399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:55.107914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:55.109070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:55.109657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:55.111563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:55.132760 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 425/866] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 19 16:19:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:55.138276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:55.166860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:55.187510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76643df3-7760-4cec-849b-187a68146321 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:55.208166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:55.230459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:55.231279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:55.231577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:55.231877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:55.232607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:55.234010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:55.254696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 442/867] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:19:55 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:55.274056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f736-f626-4cb2-a15b-79ca224b61d7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:55.331578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:55.332378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:55.332677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:55.332963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:55.416076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:55.417952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:55.435608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:55.540081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 426/868] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:19:55 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:19:55.545211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:55.655216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7714f-dc66-4136-8ce7-e03f53f56a0e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:55.699285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:55.700045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:55.700336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:55.700599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:55.712550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:55.714035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:55.732831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:55.733785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:55.734901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:55.734901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:55.734901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:55.734901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:55.734901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 443/869] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:55.742256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:55.850976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d28713-4bf4-4055-8803-cdf744fe3a6d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:55.865704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:55.888753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:55.889418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:55.893117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:55.893117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:55.893117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:55.893117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:55.893696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:55.906732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 427/870] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:55.913147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:55.952095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:56.033763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c300a-9177-4880-b6f8-7762c0a2900d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:56.070182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:56.071085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.077192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.077488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.086090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:56.087587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-44aa3371-fe6b-4936-a396-ddebe8e93355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:19:56.103369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:56.104902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:56.106459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 444/871] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:56.116283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:56.160897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5bf0-145b-49a7-85b5-6e9fcd4f8b0a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.161225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5bf0-145b-49a7-85b5-6e9fcd4f8b0a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.161466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5bf0-145b-49a7-85b5-6e9fcd4f8b0a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.163124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 445/872] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:56.169824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.169824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.169824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.185971 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:56.187162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:56.247942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f35a-65c0-4f7d-a875-e7413410c73d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:56.271671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 446/873] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:19:56.294859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:56.297407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:56.298756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.299295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.299800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.300876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:56.301424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:56.303149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:56.318243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 428/874] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:56.319420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:56.323654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:56.359732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:56.437373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd811cb-5682-4db0-904f-f014b20ed3fe None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:56.442331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f815c9-934b-4138-a851-9a63d701d046 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:56.482536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:56.483756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.484309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.484848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.486206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=4906e8d75de84c509617bc354ed860c5) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:56.486756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:56.487033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:56.487902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.488258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.488541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.489204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:56.489464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:56.490587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:56.498062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 429/875] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:19:56 2022] GET /identity/v3/role_assignments?user.id=4906e8d75de84c509617bc354ed860c5&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:56.506655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:56.507798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:56.508676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 447/876] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:19:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:56.516301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:56.628086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:56.634742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35bcf-cce9-4ccf-b75f-288848d9cb90 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:56.674951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:56.676081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.676581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.677100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.678049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:56.678574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:56.680237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f3c58-60b3-4274-8e40-f429e3c36a60 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:56.686320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 430/877] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:19:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:56.692861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:56.789278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:56.813173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b2e4d-5051-4163-bf98-b81b3a626b87 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:56.855822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:56.856496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:56.856779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:56.857054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:56.857770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:56.858081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:56.859477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2701-e604-44b3-9ff1-50569b502aa1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:56.865628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 448/878] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:19:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:57.446365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2220f0-c442-4058-8070-70c61cb770ae None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:57.446901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2220f0-c442-4058-8070-70c61cb770ae None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:57.447376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2220f0-c442-4058-8070-70c61cb770ae None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:57.450080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 431/879] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:57.456962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625361ba-8d16-4d3a-b654-441461a6a269 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:57.457269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625361ba-8d16-4d3a-b654-441461a6a269 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:57.457634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625361ba-8d16-4d3a-b654-441461a6a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:57.476984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-625361ba-8d16-4d3a-b654-441461a6a269 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:57.478195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-625361ba-8d16-4d3a-b654-441461a6a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:57.554424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 449/880] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:57.576698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2220f0-c442-4058-8070-70c61cb770ae None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:57.685738 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2220f0-c442-4058-8070-70c61cb770ae None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:57.721625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bcb80-5d14-46fc-9a54-1348b42bbc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:57.722209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bcb80-5d14-46fc-9a54-1348b42bbc5b None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:57.722574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bcb80-5d14-46fc-9a54-1348b42bbc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:57.722997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bcb80-5d14-46fc-9a54-1348b42bbc5b None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:57.724161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bcb80-5d14-46fc-9a54-1348b42bbc5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:57.726367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bcb80-5d14-46fc-9a54-1348b42bbc5b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:57.745186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 432/881] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:19:57 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:19:57.767394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc050-9603-4842-8b96-865420b6c005 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:57.767984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc050-9603-4842-8b96-865420b6c005 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:57.767984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc050-9603-4842-8b96-865420b6c005 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:57.769818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 450/882] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:57.775821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:57.776141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:57.776394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:57.801135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:57.802395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:57.824720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:57.915176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 433/883] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:57.957883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc050-9603-4842-8b96-865420b6c005 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:58.085569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:58.133203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc050-9603-4842-8b96-865420b6c005 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:58.197784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:58.198915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:58.199365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:58.199812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:58.200622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:58.202241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:58.218110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:58.219395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:19:58.220638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:58.223064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 451/884] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:58.230040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:58.343279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23840-4217-4f15-958c-a467fdbbc7df None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:58.385842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:58.386503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:58.386901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:58.387172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:58.387903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:58.388207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:58.389686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:58.395264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 434/885] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:58.404769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:58.528776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9ebb3-f6cc-41e7-93d4-66ef0a2a70b6 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:58.570066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:58.571739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:58.572535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:58.573352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:58.575062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:58.575641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:58.577269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:58.583580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 452/886] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:19:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:58.595330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:58.603948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:58.709267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972cc7-9fa1-4459-b0fd-ed9d95aecd91 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:58.748278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:58.749588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:58.750106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:58.750590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:58.752461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] RBAC: Adding query filter params (interface=public, service_id=4f98cd1d43a040549877927b8307d6ae, region_id=RegionOne) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:58.753253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:58.755072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f60df-90a2-4444-8897-7b524a160e96 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:58.762036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 435/887] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:19:58 2022] GET /identity/v3/endpoints?service_id=4f98cd1d43a040549877927b8307d6ae&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:58.768000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:58.772776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:58.883310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148180-e30d-42fd-948f-9f823932f6c5 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:58.920098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd660be8-4928-4bf6-a74a-941e96584af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:58.920774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660be8-4928-4bf6-a74a-941e96584af7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:58.921061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660be8-4928-4bf6-a74a-941e96584af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:58.921340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660be8-4928-4bf6-a74a-941e96584af7 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:58.922030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd660be8-4928-4bf6-a74a-941e96584af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:58.924088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd660be8-4928-4bf6-a74a-941e96584af7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:58.934832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 453/888] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:19:58 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:19:59.057499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb0dd-8e28-4b05-aea0-b09b49092628 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.058156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb0dd-8e28-4b05-aea0-b09b49092628 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.058662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb0dd-8e28-4b05-aea0-b09b49092628 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.060665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 436/889] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:59.066774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a279d-5a72-4835-a78f-e6da77a3a721 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.067406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a279d-5a72-4835-a78f-e6da77a3a721 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.067947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a279d-5a72-4835-a78f-e6da77a3a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.086653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a60a279d-5a72-4835-a78f-e6da77a3a721 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:59.088274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a60a279d-5a72-4835-a78f-e6da77a3a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:59.159938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:59.166418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 454/890] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:59.182478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253f15-4e07-4c4a-bdcc-c02034e1b288 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.182838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253f15-4e07-4c4a-bdcc-c02034e1b288 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.183042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253f15-4e07-4c4a-bdcc-c02034e1b288 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.184909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 437/891] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:19:59.191490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.191840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253f15-4e07-4c4a-bdcc-c02034e1b288 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:59.192229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.192662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.213576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:19:59.214877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:19:59.271039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:59.297279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 455/892] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:19:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:19:59.299712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253f15-4e07-4c4a-bdcc-c02034e1b288 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:59.320053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:59.335120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:59.335964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.336244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.336517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.347825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:19:59.357345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:59.358303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:19:59.359138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 438/893] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 19 16:19:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:19:59.364646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:59.433869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73d1da-6608-4b75-bf06-9ccdc30ec9e3 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:59.464299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:59.466926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2968cf-9712-455f-a811-970dcae8d64d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:59.475267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:59.476196 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.476721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.477147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.478055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:59.479694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:59.496913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 456/894] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:19:59 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:19:59.504458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:19:59.510756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:59.515745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.515745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.515745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.515745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:59.515745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:59.515745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:59.526366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 439/895] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:19:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:19:59.532579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:59.656204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359021f-6e5d-4aec-8eb3-70a8ff878090 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:59.695837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:59.696875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.697327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.697752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.710526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:59.712283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:19:59.730699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:19:59.731858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:19:59.732996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:19:59.732996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:19:59.732996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:19:59.732996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:19:59.734577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 457/896] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:19:59.740564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:59.850580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55407ec7-0c4c-428a-a68f-7283dda86eb1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:19:59.887222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:19:59.888244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:19:59.888680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:19:59.889102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:19:59.895586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:19:59.896148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:19:59.897714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:19:59.917466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:19:59.928088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 440/897] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:19:59.964947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.027999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2867b-ab02-4a3e-ac36-8f3acefb7f59 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:00.064436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:00.065377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.065666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.065947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.074047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:00.075520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:00.090450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:00.091435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:00.092394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 458/898] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:19:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:00.099239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.164173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.214031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b26af-2d7e-4706-ad88-3280e3ff06eb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:00.250226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:00.250846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.251136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.251415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.252289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:00.252600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:00.254035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1d44-33b2-4b7d-bf61-ab5ccdfc9cd4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:00.272856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 441/899] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:00.278707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.321396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62904f52-ebaf-44fd-a8c4-a211d849d9a5 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.321396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62904f52-ebaf-44fd-a8c4-a211d849d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.321396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62904f52-ebaf-44fd-a8c4-a211d849d9a5 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.321396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 442/900] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:00.324912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.325202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.325482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.343187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:00.344408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:00.399004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.404952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494700-8a59-40ca-ad04-02ab74b95e67 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:00.423896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 443/901] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:00.438978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.446215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:00.446854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.447189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.447466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.485004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.534658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:00.536159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:00.566705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58f32-13e7-44ba-9188-bc2e4ca7cc32 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:00.614888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:00.616019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.616937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.617376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.618592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:00.620445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:00.636520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:00.637600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:20:00.638445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:00.642811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 444/902] 10.222.0.25 () {56 vars in 1132 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:00.644795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.645862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.652512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 459/903] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:00.658109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.760754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532edae-7822-46d2-8eb5-eb87127b570b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:00.763898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.801378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4914ae-7b09-4350-a893-2ce787e2c3b2 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:00.808473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:00.809505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.810011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.810479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.811450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:00.812070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:00.814382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:00.823281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 445/904] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:00.834012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.849881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:00.851157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:00.851441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:00.851944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:00.863952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:00.865819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:00.885270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:00.886284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:00.887229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:00.887229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:00.887229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:00.887229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:00.887229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 460/905] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:00.893147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:00.963855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:00.976682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b4f4-0d84-4173-bfc3-550f7a6d3faa None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.022797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.023658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.024055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.024431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.025305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:01.025715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.026501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b9cbb-60ec-4c14-acab-3b21e07d1a02 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.027579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.038537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 446/906] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:01.040588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.069355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.070090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.070472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.070847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.071887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:01.072153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.073699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.084601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:01.091909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 461/907] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:01.095776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.183451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b8934-b361-4c60-b2fb-3a78dc6ee3c7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.224841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.226043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.226684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.227076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.228036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] RBAC: Adding query filter params (interface=public, service_id=e343ad6bb80e40408d9646942c9fd1fc, region_id=RegionOne) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:01.228554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.230630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.236720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b72c3-be99-4328-afa3-cf08f9e6775f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.241949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 447/908] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/endpoints?service_id=e343ad6bb80e40408d9646942c9fd1fc&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:01.243572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.256612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:01.281153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.282102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.282375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.282658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.292773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.294289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-e1b39691-d903-4662-9915-da1a42a87a0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:01.314008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:01.314982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:01.315922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:01.317096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 462/909] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:01.318602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb43b-e4e8-4e44-8ac2-a3e67ed9f756 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.318891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb43b-e4e8-4e44-8ac2-a3e67ed9f756 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.319172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb43b-e4e8-4e44-8ac2-a3e67ed9f756 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.320747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 463/910] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:01.325315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdb43b-e4e8-4e44-8ac2-a3e67ed9f756 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.362268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:01.369818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8281-d67f-4635-9ea8-da08fa3a5366 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.407918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f52980-8b00-4a98-ba4c-ae786923da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.408830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f52980-8b00-4a98-ba4c-ae786923da40 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.409398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f52980-8b00-4a98-ba4c-ae786923da40 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.409680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f52980-8b00-4a98-ba4c-ae786923da40 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.410372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f52980-8b00-4a98-ba4c-ae786923da40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.411910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f52980-8b00-4a98-ba4c-ae786923da40 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.426287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 448/911] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:20:01.426287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.426287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.426287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.442402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:01.443992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:01.448638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdb43b-e4e8-4e44-8ac2-a3e67ed9f756 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.499764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.500477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.501419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.501837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.502795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:01.503178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.505010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.527705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 464/912] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:01.528964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.548160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 449/913] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:01.567766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.579432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:01.679969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651532f-9983-44b6-a96a-51e1cfe25384 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.681361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:01.693978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0c36-3c60-40f6-aa16-90aea3020193 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.727038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.728845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.729360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.729900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.730954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] RBAC: Adding query filter params (role.id=58027d0970004a82ae03486f66dffe37, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=4906e8d75de84c509617bc354ed860c5) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:01.731553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.732556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.733365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.733647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.733921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.734176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.734582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.736638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.743111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 465/914] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/role_assignments?user.id=4906e8d75de84c509617bc354ed860c5&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=58027d0970004a82ae03486f66dffe37 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:01.749744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:01.750852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:01.751721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 450/915] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:01.759783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.898588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcf105-9704-4e23-bc7e-d62167ee9e67 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:01.906709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:01.940361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:01.941046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.941330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.941606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.942330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:01.942640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:01.944150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034651d-80a2-48d5-956f-ffb7ac7f7f50 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:01.950451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 466/916] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:01.956050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:01.972522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe028-81cd-4de0-a3b0-cd98d80f329f None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.973059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe028-81cd-4de0-a3b0-cd98d80f329f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.973059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe028-81cd-4de0-a3b0-cd98d80f329f None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:01.974452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 467/917] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:01.981383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:01.981670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:01.982016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.008854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:02.010313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:02.069894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c98a-dc5d-414b-8b9f-9ff54e3c1e36 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:02.103930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 468/918] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:02.111497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:02.112520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:02.113040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:02.113547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.114516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:02.115024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:02.116687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:02.122438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 451/919] 10.222.0.25 () {56 vars in 1114 bytes} [Thu May 19 16:20:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:02.126758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:02.127441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:02.163584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:02.259795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:02.269276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a90f6c-ee5e-43fa-ae6c-616e8b43d5fe None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:02.281101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0b87-a921-46f0-890d-9de0c475132a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:02.317338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:02.318148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:02.318417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:02.318692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.319338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:02.319462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:02.320304 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:02.320771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:02.320896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:02.321535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.322477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:02.324078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:02.335655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:02.336838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:02.338347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 469/920] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:02.343669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:02.358246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 452/921] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:20:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:02.465711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e16c7-0767-47e2-abbe-05e825c8d3e2 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:02.512976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:02.514021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:02.514493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:02.514991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.515930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:02.517474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:02.519553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:02.526154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 470/922] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:02.535656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:02.623171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:02.653492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922a53-bda5-4b63-883b-0d35fc0b27e9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:02.689731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:02.690777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:02.691312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:02.691829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.692790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:02.693305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:02.694972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:02.700865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 453/923] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:02.707365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:02.726306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:02.816214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dce71-193d-4f07-99d1-97fcc53c9855 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:02.851695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:02.852358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:02.852638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:02.852914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:02.853716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] RBAC: Adding query filter params (interface=public, service_id=91a09766e6d64cbaa1b81d15b5a1f708, region_id=RegionOne) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:02.854025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:02.855405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afea54a-13f4-4093-8a82-07a1a5d87ca9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:02.864552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 471/924] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:20:02 2022] GET /identity/v3/endpoints?service_id=91a09766e6d64cbaa1b81d15b5a1f708&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:02.872942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:03.002582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160f847-2014-428a-adf3-671e24af35c9 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:03.045674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e4d96-169e-4554-b43b-94ad8a188904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:03.046363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e4d96-169e-4554-b43b-94ad8a188904 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:03.046645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e4d96-169e-4554-b43b-94ad8a188904 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:03.046919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e4d96-169e-4554-b43b-94ad8a188904 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:03.047713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e4d96-169e-4554-b43b-94ad8a188904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:03.049140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e4d96-169e-4554-b43b-94ad8a188904 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:03.056512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 454/925] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:20:02 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:20:03.852333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155c48-22a6-43f1-af8f-55bdfe60bdc5 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:03.853411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155c48-22a6-43f1-af8f-55bdfe60bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:03.853917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155c48-22a6-43f1-af8f-55bdfe60bdc5 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:03.856090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 472/926] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:03.862566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e89c-5a6a-43ce-8653-2d04f6173f7d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:03.863197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e89c-5a6a-43ce-8653-2d04f6173f7d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:03.863777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e89c-5a6a-43ce-8653-2d04f6173f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:03.869635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:03.892872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2005e89c-5a6a-43ce-8653-2d04f6173f7d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:03.895262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2005e89c-5a6a-43ce-8653-2d04f6173f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:03.989162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 455/927] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:04.009009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155c48-22a6-43f1-af8f-55bdfe60bdc5 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.043862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411b67-d4aa-4c68-821b-3bdfb032e110 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.044806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411b67-d4aa-4c68-821b-3bdfb032e110 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.045418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411b67-d4aa-4c68-821b-3bdfb032e110 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.047188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 456/928] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:04.052822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.053223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.053672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.070905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:04.072248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:04.112076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:04.120521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155c48-22a6-43f1-af8f-55bdfe60bdc5 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.163763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 457/929] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:04.172971 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.174002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.174427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.174843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.175704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:04.177294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:04.187978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:04.194594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:04.195809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 16:20:04.196821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:04.202715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 473/930] 10.222.0.25 () {56 vars in 1132 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:04.204720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.262755 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:04.312487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c57b85-9b5c-40a3-a045-8c4b1f47f96e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.322164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9de9b-5721-47ab-8013-45ab542e7e4f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.361083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.361786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.362074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.362403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.363068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:04.363379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:04.364288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.364823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:04.366242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.367032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.367728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.375182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 474/931] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:04.376763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.381721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:04.386393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:04.394636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:04.395948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:04.396814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:04.399705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 458/932] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:04.406338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.504387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54877-44b6-4a9b-9d67-430e065106c9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.542168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.542835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.543250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.543504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.544272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:04.544590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:04.546092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:04.554341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aab06-0931-471d-aff4-d7d690d6b46e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.556459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 475/933] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:04.558036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.585030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:04.602008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.603078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.603709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.604220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.605408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:04.605964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:04.607767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:04.618174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 459/934] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:04.626311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.663571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:04.700548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a265749-56a7-4844-9ff2-6a2f573da527 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.740790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec56225-92a6-4cda-9905-540f193c8b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.741876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56225-92a6-4cda-9905-540f193c8b66 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.742261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56225-92a6-4cda-9905-540f193c8b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.743023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56225-92a6-4cda-9905-540f193c8b66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.743917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec56225-92a6-4cda-9905-540f193c8b66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:04.745454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec56225-92a6-4cda-9905-540f193c8b66 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:04.762481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2bf5-5f64-43c2-8dcb-346d79a45133 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:04.773570 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 476/935] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:20:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:20:04.776098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49358424-917e-4874-a7e2-2e931f0a86a6 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.776638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49358424-917e-4874-a7e2-2e931f0a86a6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.777954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49358424-917e-4874-a7e2-2e931f0a86a6 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.780488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 477/936] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:04.790470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.791130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.791911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.817369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:04.818979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:04.821451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:04.822335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:04.822599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:04.822877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:04.835950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:04.837465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:04.859373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:04.860977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:04.861906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:04.861906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:04.861906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:04.861906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:04.866665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 460/937] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:04.868391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:04.926409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:04.943130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 478/938] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:04.961987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.025566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6006f2-1d82-4b22-b2ea-34646c8caffe None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.044194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:05.092603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.093278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.093563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.093845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.095197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:05.095560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.097181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.097908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9beb6-6419-4e83-a287-4317219a00c5 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.115493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 461/939] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:05.116778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.136709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.137390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.137678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.137953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.138664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.140278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.142217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING keystone.server.flask.common [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 16:20:05.163068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.sql.core [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 16:20:05.163068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 16:20:05.163068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [parameters: {'id': 'cf403149400241ff9e1005af3df935ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 16:20:05.163068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80220) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf403149400241ff9e1005af3df935ea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf403149400241ff9e1005af3df935ea. May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application result = self._query(query) May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application conn.query(q) May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 16:20:05.181641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application result.read() May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 16:20:05.182547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application next(self.gen) May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application yield resource May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application next(self.gen) May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self.session.rollback() May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self.force_reraise() May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise self.value May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application session.commit() May 19 16:20:05.183521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._prepare_impl() May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self.session.flush() May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._flush(objects) May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application compat.raise_( May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application flush_context.execute() May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 16:20:05.184493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rec.execute(self) May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 16:20:05.185433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application result = self._query(query) May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application conn.query(q) May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application result.read() May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 16:20:05.186251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [parameters: {'id': 'cf403149400241ff9e1005af3df935ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.187132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:05.193655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf403149400241ff9e1005af3df935ea. May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.195899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 479/940] 10.222.0.25 () {60 vars in 1140 bytes} [Thu May 19 16:20:04 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:05.201375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.219094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:05.230513 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7909-9828-4d3d-a670-f768047a42a0 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.284054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.286152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.286685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.287176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.299260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.301865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:05.324443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:05.325437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:20:05.326393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:05.329686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 462/941] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:05.334592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836f39-24bf-4068-a08d-afc3f80fb15d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.335529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.351168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:05.378086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.379025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.379220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.379480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.387340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.389125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:05.410687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:05.411698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:05.412916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.421082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 480/942] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:05.421841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.471384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664878c8-229b-4fea-aadf-2251eafe661d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.512161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.512834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.513112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.513382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.514223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:05.514531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.515998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8924f84-1a2b-4765-9f8d-b47b1865bc1c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.537089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 463/943] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:05.538415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac683eba-69a7-46e9-a7dc-53b48255074a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.538696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac683eba-69a7-46e9-a7dc-53b48255074a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.538966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac683eba-69a7-46e9-a7dc-53b48255074a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.540415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 464/944] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:05.543033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac683eba-69a7-46e9-a7dc-53b48255074a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.553210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d496-0f64-43c0-ab1e-4ff90a51941f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.558170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:05.593059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.593722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.594003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.594275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.595577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:05.595910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.597881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5974be-dbbe-4378-90b3-689abfa5724d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.620599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 481/945] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:05.622199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.622499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.622781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.648831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:05.651466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:05.677482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac683eba-69a7-46e9-a7dc-53b48255074a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.692387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:05.736022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.737001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.737282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.737599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.750402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.752241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.757489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 482/946] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:05.775324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:05.776543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:05.777922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:05.777922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:05.777922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:05.777922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:05.779740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 465/947] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:05.783278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.785794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.863836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:05.914524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba20e0-d9ec-4471-8fbe-aaa3d3aa621c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.921854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd7d1c-21bd-4fac-8736-a5fd56e7b531 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:05.953369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.954725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.955006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.955279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.955995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.957399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.970258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:05.971249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:05.971547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:05.972659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:05.973543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 483/948] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:05.975355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:05.975887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:05.976861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:05.977356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:05.978962 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:05.979238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:05.995589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 466/949] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:06.001080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:06.010938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:06.092474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3b257-3945-4960-9f83-d57f36a68939 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:06.124515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04b02-6c78-4e85-8ca0-e93d26a6e872 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:06.129984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:06.130705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:06.130995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:06.131269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:06.132032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:06.132335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:06.133767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:06.143870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 484/950] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:06.146663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:06.154511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:06.169183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:06.170380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:06.170947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:06.171405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:06.180110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:06.182146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:06.200514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:06.201508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:06.202430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:06.205295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 467/951] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:06.213482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:06.250737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:06.260562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8313b2-b3d1-4b57-bfb7-fcae448afcf4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:06.298700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:06.299372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:06.301429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:06.301429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:06.301429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:06.301429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:06.302552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:06.313068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 485/952] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:06.313948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:06.325792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65a2e-d91b-4a35-896f-7d6137719add None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:06.364464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:06.366125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:06.366804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:06.367464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:06.368623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:06.369138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:06.370859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:06.389047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 468/953] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:06.390327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:06.425440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f69fb-346a-4858-9f2d-f32632a60a9a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:06.440943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:06.465858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3eb84-a27e-40d0-a29b-11da71a06330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:06.466766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3eb84-a27e-40d0-a29b-11da71a06330 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:06.467199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3eb84-a27e-40d0-a29b-11da71a06330 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:06.467789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3eb84-a27e-40d0-a29b-11da71a06330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:06.468727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3eb84-a27e-40d0-a29b-11da71a06330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:06.471057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3eb84-a27e-40d0-a29b-11da71a06330 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:06.511682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f7126-fd04-49fd-a6c1-3cda879cae04 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:06.512416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 486/954] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:20:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:06.554848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834ef91-e578-4abc-9fce-533e5c7cb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:06.555840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834ef91-e578-4abc-9fce-533e5c7cb9ab None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:06.556127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834ef91-e578-4abc-9fce-533e5c7cb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:06.556407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834ef91-e578-4abc-9fce-533e5c7cb9ab None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/4906e8d75de84c509617bc354ed860c5/roles/58027d0970004a82ae03486f66dffe37` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:06.558732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834ef91-e578-4abc-9fce-533e5c7cb9ab None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=4906e8d75de84c509617bc354ed860c5, role_id=58027d0970004a82ae03486f66dffe37)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:06.560308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834ef91-e578-4abc-9fce-533e5c7cb9ab None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:06.579240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 469/955] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:20:06 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/4906e8d75de84c509617bc354ed860c5/roles/58027d0970004a82ae03486f66dffe37 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:20:07.220241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96571-701b-4726-bd36-4d96c5e39542 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:07.220756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96571-701b-4726-bd36-4d96c5e39542 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:07.220756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad96571-701b-4726-bd36-4d96c5e39542 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:07.222400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 487/956] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:07.227675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:07.228110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:07.228302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:07.245254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:07.246459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:07.322907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 470/957] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:07.345679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96571-701b-4726-bd36-4d96c5e39542 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:07.359095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:07.464855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad96571-701b-4726-bd36-4d96c5e39542 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:07.512239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:07.513333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:07.513767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:07.514193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:07.515003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:07.516695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:07.529982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:07.531319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:07.532591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:07.535078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 488/958] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:07.540918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:07.570594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:07.648077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f3691-9f5a-431b-aca4-d09b83368241 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:07.683981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:07.684652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:07.684931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:07.685202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:07.685949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:07.686254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:07.687644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf94a95-423f-4118-a89f-369909301d18 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:07.696713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 471/959] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:07.701952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:07.789781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:07.823522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de381d-2fe5-4050-813d-7d8293edcbe8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:07.863946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:07.864759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:07.865046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:07.865326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:07.866069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:07.866381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:07.867941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9958c7-df6f-4211-be03-23cfc7190462 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:07.873964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 489/960] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:08.054566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097e97-5099-487b-bac6-dfdef1aeaa26 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.054869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097e97-5099-487b-bac6-dfdef1aeaa26 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.055088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097e97-5099-487b-bac6-dfdef1aeaa26 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.056686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 472/961] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:08.064381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.064674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.064954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.083279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:08.084525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:08.154708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 490/962] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:08.179385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097e97-5099-487b-bac6-dfdef1aeaa26 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:08.285308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:08.295064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097e97-5099-487b-bac6-dfdef1aeaa26 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:08.338006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:08.338602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.338888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.339169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.339959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:08.341527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:08.342861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING keystone.server.flask.common [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 16:20:08.357567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.sql.core [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 16:20:08.357567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 16:20:08.357567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [parameters: {'user_id': '659c5f5e112f48e7bf2c1988b8e7480f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 16:20:08.357567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80219) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result = self._query(query) May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application conn.query(q) May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result.read() May 19 16:20:08.365628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 16:20:08.366576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application next(self.gen) May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application yield resource May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application next(self.gen) May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.session.rollback() May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.force_reraise() May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise self.value May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application session.commit() May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 16:20:08.367810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._prepare_impl() May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.session.flush() May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._flush(objects) May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application compat.raise_( May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application flush_context.execute() May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rec.execute(self) May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 16:20:08.369259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 16:20:08.371024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result = self._query(query) May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application conn.query(q) May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application result.read() May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 16:20:08.377329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [parameters: {'user_id': '659c5f5e112f48e7bf2c1988b8e7480f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:08.379381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 16:20:08.381379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:08.383527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 473/963] 10.222.0.25 () {60 vars in 1131 bytes} [Thu May 19 16:20:08 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:08.384494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:08.456828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:08.496409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21704f-c4ab-48ef-958b-5e6e0351a944 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:08.536774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:08.537596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.537931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.538210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.546740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:08.548358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9f787eca-bfc5-48b7-ac6a-376d42431fa0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:08.565034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:08.567359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:08.569744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 491/964] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:08.573790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:08.680983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f39c-248c-46e2-8c9b-df9df72d52f2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:08.720219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:08.721296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.721767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.722252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.723283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:08.723835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:08.725773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b19c0-4b08-4f90-82ce-af0c8d4b3ba7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:08.770094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 474/965] 10.222.0.25 () {56 vars in 1101 bytes} [Thu May 19 16:20:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:08.923503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535391a-a089-41f9-b0a7-96ecc24e6a0a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.924176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535391a-a089-41f9-b0a7-96ecc24e6a0a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.924659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535391a-a089-41f9-b0a7-96ecc24e6a0a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.926620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 492/966] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:08.933640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:08.934251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:08.934822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:08.955417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:08.957391 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:08.966189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.013612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0ada-5290-4cb9-9365-109a1cf9a7c5 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.013947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0ada-5290-4cb9-9365-109a1cf9a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.014162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0ada-5290-4cb9-9365-109a1cf9a7c5 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.015839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 493/967] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:09.023106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.023401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.023753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.041703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 475/968] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:09.049789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:09.050999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:09.066327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.132697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 494/969] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:09.159774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.181990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52f92b-23b6-4727-8c70-74a984be925e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.222563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.223295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.223577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.223885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.224545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.225956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.228197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:09.239133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:09.240298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:09.241168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 476/970] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:09.246378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.256831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.279281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edb81-d64a-4938-abf5-cab41dc2d4dd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.317754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.318574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.318857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.319134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.330774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:09.339041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:09.340152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:09.341181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 495/971] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:09.346056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.380855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fd0a5-26b1-4666-9c07-abf29da277c6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.418239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.418913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.419199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.419475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.420222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:09.420535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.421918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.427972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 477/972] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:09.433562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.463483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980ad7-caed-4002-9315-76fed0ccddeb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.482147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.505179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.505858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.506144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.506408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.507167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:09.507475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.508902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.512308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.519401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 496/973] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:09.524890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.548753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd542c5-2016-4226-8791-0cfea3698712 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.592110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.592787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.593076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.593384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.594103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:09.594449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.595857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.606819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 478/974] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:09.607592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.645803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffab16-4266-418f-bfa7-2c9b155c0529 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.684382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.685313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.685601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.685889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.698299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.699809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.716075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce216be-3ec9-408d-a8cc-16287833de38 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:09.718584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:09.723297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:09.725531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:09.725531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:09.725531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:09.725531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:09.725531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 497/975] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:09.726106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.760920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.761501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.761786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.762066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.762608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.762869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] RBAC: Adding query filter params (interface=admin, service_id=91a09766e6d64cbaa1b81d15b5a1f708, region_id=RegionOne) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:09.763187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.765286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.767033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:09.774658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 479/976] 10.222.0.25 () {56 vars in 1249 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/endpoints?service_id=91a09766e6d64cbaa1b81d15b5a1f708&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:09.777287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.844049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a7e0-f3a4-44f5-89c3-0b28437baea9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.881860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.882866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.883428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.883782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.884639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:09.884956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.886934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.887965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029153-635c-4005-9bc1-4f9ad9c91bfb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:09.902725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 498/977] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:09.908160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:09.929863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:09.930666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:09.931019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:09.931373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:09.932170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:09.933632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:09.943768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 480/978] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:20:10.024125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:10.036548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765010-f05c-4058-ac8d-163ca56a0e00 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:10.078094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:10.079029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.079309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.079583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.088442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:10.089990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c62d0902-2b99-4ae0-8724-0b810ea9c83d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:10.107243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:10.108346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:10.112694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 499/979] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:20:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:10.117343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:10.187260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:10.228066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f6b2-4166-4425-af79-880d91f7db73 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:10.263104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:10.263834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.264125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.264405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.265267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:10.265371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f1b3-2300-467c-9438-68bf3d700caf None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.265541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f1b3-2300-467c-9438-68bf3d700caf None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.265650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:10.265829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f1b3-2300-467c-9438-68bf3d700caf None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.267046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:10.267644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 500/980] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:10.272697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.272983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.273264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.286440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 481/981] 10.222.0.25 () {56 vars in 1149 bytes} [Thu May 19 16:20:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:10.291739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:10.298004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:10.299203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:10.383792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 501/982] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:10.396078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:10.405058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dfcae-fe24-4357-8aea-22737ea27f17 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:10.427930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:10.443461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:10.444163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.444437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.444723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.497542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:10.518709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca5723-945d-40c6-8130-6fa3229a0bf1 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:10.523877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:10.525387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:10.560811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:10.561316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.561602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.561887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.562614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:10.564103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:10.581346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 502/983] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:20:10 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:20:10.634818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 482/984] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 16:20:10.640630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:10.769569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0400-a559-4bee-b09e-7d75ee9f2952 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:10.809857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:10.810673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:10.811006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:10.811224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:10.820420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:10.824663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:10.826657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:10.848579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:10.849626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:10.850533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:10.850533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:10.850533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:10.850533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:10.850994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 503/985] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:10.856399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:10.879309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:10.968657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ceb58-76bf-488f-898a-d3c9253517b7 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:11.005380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:11.006376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:11.006853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:11.007325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:11.008325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:11.008829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:11.010373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:11.023133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 483/986] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:11.028602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:11.135819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69269a-e1be-4546-9242-a77603679df9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:11.171138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:11.171972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:11.172286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:11.172565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:11.179570 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:11.181056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:11.195275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:11.196310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:11.201780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 504/987] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:11.202294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:11.286071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:11.307049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884b596-b229-4df6-bf93-048ff9f0a1b3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:11.343406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:11.344098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:11.344986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:11.345230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:11.345999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:11.346309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:11.347772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c662c-87e9-4009-9a77-2f0a72497b07 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:11.366481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 484/988] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:11.367774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:11.419535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:11.483990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817c00-9b7c-4a44-86f6-1ded2b18102b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:11.527349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:11.528016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:11.528294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:11.528566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:11.529389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] RBAC: Adding query filter params (role.id=58027d0970004a82ae03486f66dffe37, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=4906e8d75de84c509617bc354ed860c5) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:11.529694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:11.531135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345125f8-07df-43e1-abef-227f8b183d18 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:11.543704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 505/989] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:11 2022] GET /identity/v3/role_assignments?user.id=4906e8d75de84c509617bc354ed860c5&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=58027d0970004a82ae03486f66dffe37 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:12.245371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb47a2-ab86-4dd4-b6e0-57cab7866f1c None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.245871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb47a2-ab86-4dd4-b6e0-57cab7866f1c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.245871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb47a2-ab86-4dd4-b6e0-57cab7866f1c None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.247350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 485/990] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:12.252772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.253073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.253358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.270361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:12.271552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:12.343735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 506/991] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:12.365895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb47a2-ab86-4dd4-b6e0-57cab7866f1c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:12.473818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb47a2-ab86-4dd4-b6e0-57cab7866f1c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:12.510205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:12.510933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.511217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.511492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.512180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:12.513554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:12.526259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:12.527594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:12.528486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 486/992] 10.222.0.25 () {56 vars in 1126 bytes} [Thu May 19 16:20:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:12.535753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:12.581314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:12.637905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098628-2c88-4bfc-b12c-6715cc21dd75 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:12.678693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:12.679387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.679718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.680003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.680741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:12.681056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:12.682517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:12.692958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 507/993] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:12.694252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:12.698360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:12.806386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b72a-a15b-485c-ba83-44ccd18ec10c None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:12.842723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:12.843393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.845428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.845428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.845428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:12.845867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:12.850988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48adde0-c31c-4fff-b201-c8f972d2a610 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:12.862166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 487/994] 10.222.0.25 () {56 vars in 1122 bytes} [Thu May 19 16:20:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:12.863468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:12.884423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcc450-da93-4146-820b-9dd0eb9414d0 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.884698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcc450-da93-4146-820b-9dd0eb9414d0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.884977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcc450-da93-4146-820b-9dd0eb9414d0 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.886484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 488/995] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:12.894938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:12.894938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:12.894938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:12.910914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:12.914960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:12.985220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:12.993179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 489/996] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:12.999545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de262df-d0aa-441c-bae5-e738a3057f8b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:13.010023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:13.015856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:13.043199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:13.044342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.044342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.044551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.045181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:13.046565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:13.065521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 508/997] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:20:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:13.142292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc452f-343d-4d42-aa36-108b62b8b33c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:13.190247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:13.191066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.191352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.191641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.192328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:13.193746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:13.207241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:13.208574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:13.209435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:13.212078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 490/998] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:13.214807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:13.326117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f44c-1b94-49c2-be65-6db246c5fbff None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:13.362711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:13.363392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.363703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.363984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.364702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:13.365016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:13.366406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:13.377104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 509/999] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:13.378728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:13.446370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:13.493520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a361b-2f0c-4ac6-ada2-7af050ea9332 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:13.531250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:13.531993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.532283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.532565 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.533299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:13.533620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:13.535099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:13.545726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 491/1000] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:13.548007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:13.581950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:13.660898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd6697-49e2-4bc5-95d4-5cffd6c626a1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:13.700144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:13.700838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.701125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.701404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.702207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] RBAC: Adding query filter params (interface=public, service_id=f0b597bfe3fc401ba9946f9df8f90bb6, region_id=RegionOne) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:13.702523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:13.703993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8d004-9005-4dcb-a68b-1b0439e7fd2f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:13.710003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 510/1001] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:20:13 2022] GET /identity/v3/endpoints?service_id=f0b597bfe3fc401ba9946f9df8f90bb6&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:13.715341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:13.828458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfeb16-a31c-474b-bb59-252788fe8952 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:13.843581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b518ed-05c4-412a-a211-269e8f1cdb69 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.843795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b518ed-05c4-412a-a211-269e8f1cdb69 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.844610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b518ed-05c4-412a-a211-269e8f1cdb69 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.846281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 511/1002] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:13.851824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.852102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.852384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.855681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:13.870747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:13.871778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:13.871989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:13.872462 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:13.872749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:13.873048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:13.873802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:13.875267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:13.895654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 492/1003] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:20:13 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:20:13.964565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 512/1004] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:13.987607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:14.120663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e8be-9e46-4ef6-805f-fb969138037f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:14.154012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:14.154798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:14.155079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:14.155357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] PATH_INFO: `/v3/services/image` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:14.156038 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:14.157985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:14.169393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:14.170604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:14.171562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 493/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Thu May 19 16:20:13 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:14.176682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:14.207166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:14.293757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10c09-bd34-4549-bd00-25940254a398 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:14.331315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:14.332014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:14.332300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:14.332577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:14.333292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] RBAC: Adding query filter params (name=image) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:14.333606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:14.335001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c3168-6b5f-4a6a-80c6-14615d92db6d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:14.340294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 513/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:14.346497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:14.422289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:14.484104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df8c7-cfe2-4528-926a-a26bd8268d2b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:14.522016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:14.522684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:14.522967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:14.523250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:14.523984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] RBAC: Adding query filter params (type=image) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:14.524294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:14.525659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a032e0-0dd1-472b-9138-086e953e0478 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:14.530657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 494/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:15.352105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4abe5-cba6-450e-95c1-dced8d0d20c7 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:15.352595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4abe5-cba6-450e-95c1-dced8d0d20c7 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:15.352595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4abe5-cba6-450e-95c1-dced8d0d20c7 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:15.354003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 514/1008] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:15.359162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:15.359518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:15.360501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:15.377375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:15.378537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:15.446060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 495/1009] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:15.468553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4abe5-cba6-450e-95c1-dced8d0d20c7 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:15.562899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:15.574774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4abe5-cba6-450e-95c1-dced8d0d20c7 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:15.609036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f0172-068f-42d9-9a9d-3fb3a3f3333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:15.610317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f0172-068f-42d9-9a9d-3fb3a3f3333a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:15.610781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f0172-068f-42d9-9a9d-3fb3a3f3333a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:15.611062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f0172-068f-42d9-9a9d-3fb3a3f3333a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:15.612331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f0172-068f-42d9-9a9d-3fb3a3f3333a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:15.613826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f0172-068f-42d9-9a9d-3fb3a3f3333a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:15.615757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 515/1010] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:15.621623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:15.668236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:15.724674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c454d-67d0-4f66-aeed-0b92554dccad None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:15.759042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77980-7589-42a7-974f-4c1b497c84bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:15.759728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77980-7589-42a7-974f-4c1b497c84bc None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:15.760012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77980-7589-42a7-974f-4c1b497c84bc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:15.760286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77980-7589-42a7-974f-4c1b497c84bc None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:15.760994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77980-7589-42a7-974f-4c1b497c84bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:15.762437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77980-7589-42a7-974f-4c1b497c84bc None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:15.795713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 496/1011] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:20:15 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:16.159920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185606-6dc4-4df2-a31a-11e26550a36b None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.160244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185606-6dc4-4df2-a31a-11e26550a36b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.160453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185606-6dc4-4df2-a31a-11e26550a36b None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.161817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 516/1012] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:16.167032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.167396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.167781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.184544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:16.185709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:16.256536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 497/1013] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:16.279561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd185606-6dc4-4df2-a31a-11e26550a36b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:16.383413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd185606-6dc4-4df2-a31a-11e26550a36b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:16.417901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:16.418614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.418895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.419167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.419836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:16.421210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:16.433232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:16.434419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 16:20:16.435746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:16.439720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 517/1014] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:16.441309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:16.468668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:16.552104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b622a-eceb-4445-b048-c1332791d722 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:16.593472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:16.594179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.594463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.594735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.595446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:16.595780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:16.597196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c815-11c9-498b-b6ae-820b965c7a2b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:16.607027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 498/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:16.608661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:16.637028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:16.718538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6960-721a-4c3e-98f7-fcd96e2a15c4 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:16.752825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:16.753469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.753753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.754027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.754368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac180-ff5d-4357-b334-4acfcaf92d3a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.754666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac180-ff5d-4357-b334-4acfcaf92d3a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.754913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:16.755010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac180-ff5d-4357-b334-4acfcaf92d3a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.755224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:16.756475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 499/1016] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:16.756705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:16.761187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.761490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.761752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.762222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 518/1017] 10.222.0.25 () {56 vars in 1112 bytes} [Thu May 19 16:20:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:16.768777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:16.778716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:16.779946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:16.848331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 500/1018] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:16.858274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:16.871901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:16.877442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7a6a1-b365-4228-92fa-a22c860b55a8 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:16.898773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:16.926151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c846e0-0c96-4ee2-ac72-e7fd5c945135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:16.926904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c846e0-0c96-4ee2-ac72-e7fd5c945135 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:16.927262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c846e0-0c96-4ee2-ac72-e7fd5c945135 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:16.927624 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c846e0-0c96-4ee2-ac72-e7fd5c945135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:16.928394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c846e0-0c96-4ee2-ac72-e7fd5c945135 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:16.929787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c846e0-0c96-4ee2-ac72-e7fd5c945135 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:16.959653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 519/1019] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:20:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:20:17.004436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654533-9299-4be5-9c5c-7384fbd899d1 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:17.050298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e05ebd-f063-4b2d-a5ea-3ec693a61101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:17.050987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e05ebd-f063-4b2d-a5ea-3ec693a61101 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:17.051270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e05ebd-f063-4b2d-a5ea-3ec693a61101 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:17.051547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e05ebd-f063-4b2d-a5ea-3ec693a61101 None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:17.052326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e05ebd-f063-4b2d-a5ea-3ec693a61101 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:17.053749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e05ebd-f063-4b2d-a5ea-3ec693a61101 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:17.071077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 501/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:20:16 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:20:18.082049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680699e-40c9-4e37-99e8-38dd0dea62dc None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:18.082600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680699e-40c9-4e37-99e8-38dd0dea62dc None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:18.082600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680699e-40c9-4e37-99e8-38dd0dea62dc None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:18.084194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 520/1021] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:18.089266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:18.090452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:18.090452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:18.106762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:18.107987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:18.196704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 502/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:18.221405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680699e-40c9-4e37-99e8-38dd0dea62dc None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:18.347963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680699e-40c9-4e37-99e8-38dd0dea62dc None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:18.385253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fe1d7-0516-4086-8480-bebad178142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:18.386059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe1d7-0516-4086-8480-bebad178142e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:18.386343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe1d7-0516-4086-8480-bebad178142e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:18.386616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe1d7-0516-4086-8480-bebad178142e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:18.387847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fe1d7-0516-4086-8480-bebad178142e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:18.389304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fe1d7-0516-4086-8480-bebad178142e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:18.391141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 521/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:18.399645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:18.400279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:18.503930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b69e-0531-4b2e-8f27-96512ba19924 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:18.539233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd55d5-a87c-48ef-83e0-4a15f11c45fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:18.539943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd55d5-a87c-48ef-83e0-4a15f11c45fd None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:18.540231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd55d5-a87c-48ef-83e0-4a15f11c45fd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:18.540509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd55d5-a87c-48ef-83e0-4a15f11c45fd None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:18.541218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd55d5-a87c-48ef-83e0-4a15f11c45fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:18.542661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd55d5-a87c-48ef-83e0-4a15f11c45fd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:18.564482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 503/1024] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:20:18 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:19.366545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a2e3-5893-442d-8c56-3be47fa17260 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.367074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a2e3-5893-442d-8c56-3be47fa17260 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.367074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a2e3-5893-442d-8c56-3be47fa17260 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.368527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 522/1025] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:19.373877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec33d-f367-4758-9568-ae7785417790 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.374495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec33d-f367-4758-9568-ae7785417790 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.374726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec33d-f367-4758-9568-ae7785417790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.375692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98054e-673c-4676-840a-6862027a0ab9 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.375981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98054e-673c-4676-840a-6862027a0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.376265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98054e-673c-4676-840a-6862027a0ab9 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.377598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 523/1026] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:19.382932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.383244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.383531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.393070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-981ec33d-f367-4758-9568-ae7785417790 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:19.394246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-981ec33d-f367-4758-9568-ae7785417790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:19.404827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:19.406392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:19.410613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:19.459753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:19.491789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 504/1027] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:19.494911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 524/1028] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:19.508422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ec33d-f367-4758-9568-ae7785417790 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:19.518228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:19.616731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ec33d-f367-4758-9568-ae7785417790 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:19.631822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7bd67-3a6b-485f-a7fd-1d764aade6e0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:19.652386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:19.653203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.653486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.653764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.663927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:19.671490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:19.672605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:19.673523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:19.674740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 505/1029] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 19 16:20:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:19.675887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.675887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.675887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.675887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:19.677222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:19.679631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:19.690712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:19.691789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:19.692650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 525/1030] 10.222.0.25 () {56 vars in 1105 bytes} [Thu May 19 16:20:19 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:19.697927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:19.701855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:19.736223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:19.795525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216e493-e8c1-49f3-bf66-1c636d6bbac5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:19.819669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ed3b7-c354-414b-b877-eaed5d51a1b1 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:19.836159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:19.836836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.837122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.837528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.838294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:19.838609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:19.840058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:19.850284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 506/1031] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:20:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:19.855564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:19.856708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:19.857388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:19.857671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:19.857945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:19.858662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:19.858969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:19.860969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:19.871125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 526/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:19.872083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:19.950992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:19.972578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b85b5-2f0f-4873-acdc-f585720bec52 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:19.983020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:19.995291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125c9c7-5128-475d-bb84-beb1467da7c2 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.007375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.008299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.008587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.008864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.020270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.021722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.031114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.032338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.032613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.032882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.033581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:20.033884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.035246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:20.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:20.040752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:20.041661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:20.041661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:20.041661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:20.041661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:20.041661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 507/1033] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:20.048169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 527/1034] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:20.048899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.049012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.159713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca445-de9f-4d4e-a813-44057b3207f3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.169692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb485-edfc-4fca-aa65-f9766b2fd411 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.189108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:20.195297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.195983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.196540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.196540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.197337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] RBAC: Adding query filter params (interface=public, service_id=d40f6945e87948d1928d9bdaba0c15ba, region_id=RegionOne) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:20.197651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.199038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.209194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 528/1035] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/endpoints?service_id=d40f6945e87948d1928d9bdaba0c15ba&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:20.210186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.212505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.213171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.213444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.213721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.214439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:20.214745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.216148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.229358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 508/1036] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:20.234818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.260104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:20.318272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac4485-18a3-47e0-8d3d-e1dabff5ca71 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.343812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80882c-2e45-4dee-972a-618b5c51d767 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.355236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.356018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.356301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.356599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.357259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.358660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.366498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 529/1037] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:20:20.382340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.383827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.384307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.384760 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.394410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.396217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:20.414721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:20.415771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:20.416741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 509/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:20.422407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.491174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:20.539083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696890e-1b59-4fde-87d9-9a3d485f156c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.575249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.575957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.576241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.576516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.577370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:20.577682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.579796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63046d1-f48e-43b0-9d61-df5e50292c0d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.599340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 530/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:20.605249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.700458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:20.722117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baed8c-3c8f-4ede-950a-caa84cd1d3f4 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:20.757088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:20.757790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.758080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.758356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.827220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:20.829348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:20.874626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3641e1-7f6d-4c23-81ee-871b5b762d7f None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.874928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3641e1-7f6d-4c23-81ee-871b5b762d7f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.875798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3641e1-7f6d-4c23-81ee-871b5b762d7f None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.877286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 531/1040] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:20.882411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:20.882658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:20.882943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:20.900269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:20.902985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:20.922720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:20.947562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 510/1041] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:20.948637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:20.980825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 532/1042] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:21.005099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.053745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69a1bf-3aa8-45f5-9512-f10f2a3262cb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.060281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.091086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.091924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.092212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.092490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.103459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.104971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.115353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35b7d-9e51-48dc-965f-728bb024a9e2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:21.129115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:21.130205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:21.131175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:21.131175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:21.131175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:21.131175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:21.131175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 511/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:21.135936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.160035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.160870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.161126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.161401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.172771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:21.173564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:21.180572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:21.181574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:21.182423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 533/1044] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:21.187578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.247521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4098-96ed-44c7-be99-c47eaa1060ac None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.282629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.283316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.283601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.283909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.284642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:21.284955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.286385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.292620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500309-5680-4dac-b5a5-8951e3a62922 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.302925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 512/1045] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:21.303985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.305654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.337245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.337915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.338199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.338479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.339221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:21.339534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.340951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.349622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 534/1046] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:21.355136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.412748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.423693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b256-b62a-4a88-9810-522c7defe341 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.461131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2975-5834-492e-9845-ce879048e25c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.461693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.462384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.462770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.463041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.471749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.473337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:21.490822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:21.491838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:21.492855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 513/1047] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:21.498059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.500013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.500905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.501192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.501471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] PATH_INFO: `/v3/users/261eca30fc5e4b988c3be48c09a65ddc` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.516484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] RBAC: Authorizing `identity:get_user(user_id=261eca30fc5e4b988c3be48c09a65ddc)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.517999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.524526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 535/1048] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/users/261eca30fc5e4b988c3be48c09a65ddc => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:21.525754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.556446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.621402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f26d-679f-4434-b5ff-822f675e3cbb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.635590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4312b6-79eb-4d30-ac13-6df427d87baa None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.660216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.660890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.661235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.661447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.662236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:21.662548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.664011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.673259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.673912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.674190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.674461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.677266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 514/1049] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:21.682700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.698781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.750654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.752061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.781040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.792509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0539d1-b516-4e05-bc2f-c1fbf6948642 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:21.829827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:21.830470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:21.830752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:21.831029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:21.831883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] RBAC: Adding query filter params (role.id=58027d0970004a82ae03486f66dffe37, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=87dd16048e5244f4adc3f5859d6ea8e9) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:21.832195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:21.833933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:21.839305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 515/1050] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/role_assignments?user.id=87dd16048e5244f4adc3f5859d6ea8e9&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=58027d0970004a82ae03486f66dffe37 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:21.868124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 536/1051] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 16:20:21.872841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:21.969990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:21.994754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7a31-932b-4915-8805-874dd106f4fe None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:22.038710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b4abb-045b-40b2-ac89-925bdaadecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:22.039494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b4abb-045b-40b2-ac89-925bdaadecfb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:22.039800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b4abb-045b-40b2-ac89-925bdaadecfb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:22.040076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b4abb-045b-40b2-ac89-925bdaadecfb None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:22.041244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b4abb-045b-40b2-ac89-925bdaadecfb None admin] RBAC: Authorizing `identity:get_project(project_id=8d0d668dc3f14358990b8972c243a1e0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:22.042678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b4abb-045b-40b2-ac89-925bdaadecfb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:22.044595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 516/1052] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:21 2022] GET /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:22.050938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:22.155325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb539b0-13bd-4abc-8140-78ca0397b8c7 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:22.182873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:22.193220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:22.193895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:22.194179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:22.194458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:22.195295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=8d0d668dc3f14358990b8972c243a1e0, user.id=261eca30fc5e4b988c3be48c09a65ddc) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:22.195627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:22.197105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f3688-f3c2-430e-9237-cb31876a2504 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:22.207708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 537/1053] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:22 2022] GET /identity/v3/role_assignments?user.id=261eca30fc5e4b988c3be48c09a65ddc&scope.project.id=8d0d668dc3f14358990b8972c243a1e0&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:22.635112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef260cf-878e-4dd6-b7e1-fbf9be293c87 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:22.635679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef260cf-878e-4dd6-b7e1-fbf9be293c87 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:22.635679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef260cf-878e-4dd6-b7e1-fbf9be293c87 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:22.637108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 517/1054] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:22.642343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:22.642749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:22.642914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:22.660161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:22.661352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:22.733077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 538/1055] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:22.756433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef260cf-878e-4dd6-b7e1-fbf9be293c87 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:22.862323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef260cf-878e-4dd6-b7e1-fbf9be293c87 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:22.900379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:22.901169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:22.901451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:22.901989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] PATH_INFO: `/v3/services/image` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:22.902637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:22.904050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:22.915660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:22.916721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:22.922628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 518/1056] 10.222.0.25 () {56 vars in 1105 bytes} [Thu May 19 16:20:22 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:22.926276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:23.036296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c39271-ba1c-4655-8557-a8116c77a746 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:23.059452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:23.071721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:23.072388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:23.072666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:23.072935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:23.073636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:23.073941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:23.075314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:23.084824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 539/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:23.086397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:23.100121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:23.193020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7c7b-541b-470e-8a9d-baacdf9cf17a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:23.229086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:23.229756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:23.230043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:23.230323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:23.231027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] RBAC: Adding query filter params (type=image) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:23.231337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:23.232747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4f7fa-20ff-4dd8-ae66-e69628a08e6d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:23.237843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 519/1058] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:23.243426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:23.350187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6b889-9289-43fa-b9b1-ae8d719f0dc7 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:23.385433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844155-951c-4ae6-bf2b-1f8c088b9d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:23.386100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844155-951c-4ae6-bf2b-1f8c088b9d06 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:23.386384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844155-951c-4ae6-bf2b-1f8c088b9d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:23.386662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844155-951c-4ae6-bf2b-1f8c088b9d06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:23.387415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844155-951c-4ae6-bf2b-1f8c088b9d06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:23.388941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844155-951c-4ae6-bf2b-1f8c088b9d06 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:23.410573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 540/1059] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:20:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:24.083713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496a4a6-27b2-4aad-acf4-fceefc98947a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.084255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496a4a6-27b2-4aad-acf4-fceefc98947a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.084255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496a4a6-27b2-4aad-acf4-fceefc98947a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.085818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 520/1060] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:24.090895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.091342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.091498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.109131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:24.110339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:24.149161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:24.190317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 541/1061] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:24.213830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496a4a6-27b2-4aad-acf4-fceefc98947a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.300875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:24.329051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496a4a6-27b2-4aad-acf4-fceefc98947a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:24.363808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2458-f0e1-4e25-9f37-98f1cd89e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:24.364649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2458-f0e1-4e25-9f37-98f1cd89e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.364936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2458-f0e1-4e25-9f37-98f1cd89e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.365213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2458-f0e1-4e25-9f37-98f1cd89e4c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.376841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b2458-f0e1-4e25-9f37-98f1cd89e4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-192b2458-f0e1-4e25-9f37-98f1cd89e4c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:24.385392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:24.386413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:24.387292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 521/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:24.394666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.412072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef296fa-7e8e-4948-8509-4adf998891cf None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.412329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef296fa-7e8e-4948-8509-4adf998891cf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.412571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef296fa-7e8e-4948-8509-4adf998891cf None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.414073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 522/1063] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:24.419432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.419745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.420031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.436579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:24.438390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:24.504114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340294c-4ad5-4d88-b10c-79025d7a53f6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:24.510842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 523/1064] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:24.533702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.545499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:24.546174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.546461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.546767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.547528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:24.547866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:24.549259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:24.557583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 542/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:24.563807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.597366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:24.604487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:24.646804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cbded-7325-4dcd-8ca5-a8c323488212 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:24.679482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af3fc-c0ab-4659-aa07-46e90e6f4399 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:24.682564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:24.683361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.683672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.683953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.696377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:24.705034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:24.706155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:24.707012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 524/1066] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:24.711899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.720484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:24.721671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.721952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.722220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.734099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:24.735594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:24.754107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:24.755064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:24.760652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:24.760652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:24.760652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:24.760652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:24.760652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 543/1067] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:24.760951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.822617 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036821d0-97ba-4840-8ad3-90d41ec265bb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:24.842072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:24.850274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:24.861751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe774c-b77b-4aea-a7e8-78954f0eb103 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:24.863284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:24.864112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.864451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.864733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.865523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:24.865840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:24.867311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:24.880731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 525/1068] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:24.881713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.908318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:24.909263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:24.909553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:24.909830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:24.910564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:24.910886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:24.912322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:24.929309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 544/1069] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:24.930250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:24.994953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f008e5-f7e6-46d6-9d8d-7786b04ab103 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.031328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.032232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.032519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.032797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] PATH_INFO: `/v3/users/261eca30fc5e4b988c3be48c09a65ddc` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.033077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e807-4b7f-4a2b-ba28-64f7901cc29e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.034007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] RBAC: Authorizing `identity:get_user(user_id=261eca30fc5e4b988c3be48c09a65ddc)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.035752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.041996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 526/1070] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/users/261eca30fc5e4b988c3be48c09a65ddc => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:25.042944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.070418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.071368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.071679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.072280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.081702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.083172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:25.098328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:25.100129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:25.101192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 545/1071] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:20:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:25.103933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:25.105425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.109220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:25.157438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c99a5e-d1f4-4580-8f88-6130c468a53f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.196646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.197434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.197719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.197998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.199197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0d668dc3f14358990b8972c243a1e0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.200687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.207691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 527/1072] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:25.208775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.228160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0477ba-1c80-4e75-8f89-5a07467ee4a3 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.267492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.268234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.268514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.268794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.269640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:25.269955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.271407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.290483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 546/1073] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:25.296584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.318489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35a265-f194-4a7d-991d-abd80c982af4 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.341854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:25.355576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.356581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.356876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.357157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0/users/261eca30fc5e4b988c3be48c09a65ddc/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.357482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:25.359957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d0d668dc3f14358990b8972c243a1e0, user_id=261eca30fc5e4b988c3be48c09a65ddc, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.361527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.374684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 528/1074] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:20:25 2022] PUT /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0/users/261eca30fc5e4b988c3be48c09a65ddc/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:20:25.403976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2b19b-3386-4d3b-9d4f-8ab602eb2b13 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.444187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.445037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.445321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.445598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.457222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.458667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:25.478179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:25.479214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:25.480696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:25.480696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:25.480696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:25.480696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:25.480696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 547/1075] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:25.487734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.603922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65fe32-9ffc-4ea9-92d1-27054a2e1727 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.639414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.640113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.640419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.640699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.641427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:25.641735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.643115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f33b0e-1827-42dc-b085-d9f6eaefa547 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.655312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 529/1076] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:25.661123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.719794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1414a-66af-4d3f-9e04-9538d71bd5ec None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.720026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1414a-66af-4d3f-9e04-9538d71bd5ec None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.720342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1414a-66af-4d3f-9e04-9538d71bd5ec None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.722780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 530/1077] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:25.727787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.728081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.728360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.747923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:25.749106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:25.767359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10313b9-b0e1-4fe5-872e-2b05f1071f17 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.781973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:25.797740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:25.806074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:25.806392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:25.806674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:25.806953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:25.816194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:25.818763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:25.833469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:25.834426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:25.840351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 548/1078] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:25.840871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.847593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 531/1079] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:25.870038 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:25.960723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925baa-f0fe-44f8-ab43-95b668216024 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.977731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7374ae5-ca33-4e13-954c-49114743b1f7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:25.999941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:26.000611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:26.000910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:26.001175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:26.001962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:26.002272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:26.003745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:26.015179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:26.016104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 549/1080] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:26.016363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:26.016656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:26.016942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:26.021797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:26.055531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:26.061736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:26.090588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:26.092077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:26.133007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e8dfb-16a4-4e61-866b-708bef9e4deb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:26.174761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:26.175674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:26.175962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:26.176231 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/87dd16048e5244f4adc3f5859d6ea8e9/roles/58027d0970004a82ae03486f66dffe37` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:26.178452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=87dd16048e5244f4adc3f5859d6ea8e9, role_id=58027d0970004a82ae03486f66dffe37)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:26.179925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:26.194028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 550/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:20:26 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/87dd16048e5244f4adc3f5859d6ea8e9/roles/58027d0970004a82ae03486f66dffe37 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:20:26.206450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 532/1082] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:26.208791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:26.309779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:26.331191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e1d4-c095-4c1e-814a-92327d58ac6b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:26.367770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:26.369987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:26.369987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:26.369987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:26.383102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:26.384670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-526f7ea7-671c-4410-ab43-939c61368420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:26.403063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:26.404047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:26.405104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:26.405104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:26.405104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:26.405104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:26.405104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 551/1083] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:26.412319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:26.489500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:26.529233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cf8a6-18b4-4bd2-8dd2-5b0eaf549cab None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:26.570337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:26.570921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:26.571200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:26.571470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:26.572217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:26.572523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:26.573890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dccb4-1852-4ad8-895f-6aed7b3c9288 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:26.591658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 533/1084] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:27.645211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e96c8-0acb-44e2-baf1-228debcb65a2 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:27.645744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e96c8-0acb-44e2-baf1-228debcb65a2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:27.645744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e96c8-0acb-44e2-baf1-228debcb65a2 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:27.647144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 552/1085] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:27.652659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:27.653100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:27.653229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:27.669878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:27.671057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:27.737131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 534/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:27.761095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e96c8-0acb-44e2-baf1-228debcb65a2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:27.881105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e96c8-0acb-44e2-baf1-228debcb65a2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:27.920385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:27.921109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:27.921391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:27.922204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:27.932481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:27.940731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:27.941894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:27.942793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 553/1087] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:27.948446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.007777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.046331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dbfdd-7b85-47f0-b716-d78ce1d2a3ca None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.080165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.080833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.081145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.081426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.082173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:28.082485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:28.083911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:28.092146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 535/1088] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:28.101064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.105636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.203723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35841f-2e0c-49dd-8234-08959ea26798 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.244422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643e436-8573-468f-b526-32f5eaff4447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.245305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643e436-8573-468f-b526-32f5eaff4447 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.245585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643e436-8573-468f-b526-32f5eaff4447 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.245858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643e436-8573-468f-b526-32f5eaff4447 None admin] PATH_INFO: `/v3/users/261eca30fc5e4b988c3be48c09a65ddc` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.247078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643e436-8573-468f-b526-32f5eaff4447 None admin] RBAC: Authorizing `identity:get_user(user_id=261eca30fc5e4b988c3be48c09a65ddc)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:28.248588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643e436-8573-468f-b526-32f5eaff4447 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:28.250266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 554/1089] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/users/261eca30fc5e4b988c3be48c09a65ddc => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:28.255858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.353212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0824c0b-d3fd-42d9-8a32-3b9911416323 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.376170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.387006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.387676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.387959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.388232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.403717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c463-6eea-49a7-bf98-312fbf7940dc None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.404012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c463-6eea-49a7-bf98-312fbf7940dc None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.404298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c463-6eea-49a7-bf98-312fbf7940dc None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.405671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 555/1090] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:20:28.411220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410349-feed-4e50-9909-554929501f85 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.411514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410349-feed-4e50-9909-554929501f85 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.411821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410349-feed-4e50-9909-554929501f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.428292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2e410349-feed-4e50-9909-554929501f85 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:28.429469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2e410349-feed-4e50-9909-554929501f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:28.465968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:28.467344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:28.499195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 556/1091] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:28.522893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410349-feed-4e50-9909-554929501f85 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.524992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.566328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 536/1092] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:28.572073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.596389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.623486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410349-feed-4e50-9909-554929501f85 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.658086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.658885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.659164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.659437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.669961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:28.670758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b24b-cbb8-4d67-a971-61e661ab02ea None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:28.678274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:28.679310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 16:20:28.680218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:28.683776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 557/1093] 10.222.0.25 () {56 vars in 1120 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:28.685262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.705993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.707345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.707726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.708007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.709324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0d668dc3f14358990b8972c243a1e0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:28.710808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:28.712530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 537/1094] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:28.718348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.746750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.787534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48ae96-ec77-4903-b138-f88428c398ce None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.808717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.818106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b53c-4ce1-4144-a975-d37c1a052231 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.821662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.822325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.822606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.822887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.823672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:28.823981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:28.825366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:28.834026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 558/1095] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:28.839712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:28.852271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.852919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.853201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.853478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:28.854301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=8d0d668dc3f14358990b8972c243a1e0, user.id=261eca30fc5e4b988c3be48c09a65ddc) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:28.854615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:28.856097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:28.861867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 538/1096] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/role_assignments?user.id=261eca30fc5e4b988c3be48c09a65ddc&scope.project.id=8d0d668dc3f14358990b8972c243a1e0&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:28.958709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f58b2f-017f-450f-aded-ca7ff3e7656a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:28.983191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:28.994884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:28.995722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:28.996003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:28.996274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:29.009156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:29.010648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:29.029489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:29.030671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:29.031666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:29.031666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:29.031666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:29.031666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:29.031666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 559/1097] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:29.036772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:29.137137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de778262-1334-4fdf-b6cc-e9249c58a590 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:29.169842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:29.170500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:29.170781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:29.171054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:29.172325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:29.172631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:29.173991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:29.185230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 539/1098] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:29.191586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:29.292278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf59778-9fcc-49c2-9560-49386425017d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:29.325816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:29.326593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:29.326869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:29.327136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:29.334573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:29.336053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:20:29.349765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:29.350911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:29.356670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 560/1099] 10.222.0.25 () {56 vars in 1093 bytes} [Thu May 19 16:20:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:29.357270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:29.376635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:29.459117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74002a4-d3ec-43a0-9b64-73dc6426e460 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:29.492929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:29.493596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:29.493880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:29.494154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:29.494983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:29.495290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:29.496744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:29.513715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 540/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Thu May 19 16:20:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:29.519638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:29.555097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:29.620007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1358cb-f54b-4da8-b903-50ca9bce5659 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:29.653853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:29.654504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:29.654790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:29.655066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:29.722008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:29.723484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:29.756357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:29.820180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 561/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:29.825941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:29.899867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:29.925691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5604d-7199-45e5-badc-9f9cc61a2a94 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:29.959154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:29.959967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:29.960258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:29.960527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:29.971392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:29.972867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:29.990331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:29.991414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:29.992384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:20:29.992384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:29.992384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:20:29.992384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:29.992384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 541/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:29.997724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:30.096614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c343f01-8203-4775-8fd2-5fc9f81d2511 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:30.129395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:30.130058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:30.130343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:30.130623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:30.131347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:30.131682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:30.133126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:30.135502 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:30.145639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 562/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:30.151208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:30.247062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70c0e-5906-4e2a-a4de-7911c6d20f29 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:30.273598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:30.282179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:30.282985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:30.283266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:30.283538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:30.289977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:30.291406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:20:30.304578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:30.305610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:30.311111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 542/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:20:30.311608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:30.409159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b1a38-dbcb-4617-a0bd-cf9d99c3d794 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:30.442652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:30.443306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:30.443584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:30.443881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:30.444650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:30.444951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:30.446390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55258e38-03d7-47a6-9197-82d192ad1639 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:30.458724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 563/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:30.464701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:30.561586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188316-3b8a-4852-b1cb-9e9a7dff8d33 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:30.594732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:30.595370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:30.595676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:30.595952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:30.596776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] RBAC: Adding query filter params (role.id=58027d0970004a82ae03486f66dffe37, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=87dd16048e5244f4adc3f5859d6ea8e9) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:30.597086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:30.598515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2af6b9-846c-43d2-a7f7-0d5999dd873b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:30.604314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 543/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:30 2022] GET /identity/v3/role_assignments?user.id=87dd16048e5244f4adc3f5859d6ea8e9&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=58027d0970004a82ae03486f66dffe37 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:31.102139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6297-42c9-4780-85b9-9fda69734282 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:31.102651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6297-42c9-4780-85b9-9fda69734282 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:31.102740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6297-42c9-4780-85b9-9fda69734282 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:31.104094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 564/1107] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:31.110093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:31.110536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:31.110642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:31.127357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:31.128575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:31.185366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:31.210824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 544/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:31.236739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def6297-42c9-4780-85b9-9fda69734282 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:31.297984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:31.342671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def6297-42c9-4780-85b9-9fda69734282 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:31.378075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b149d2-e2d7-49e1-92b3-034f7b350cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:31.378878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b149d2-e2d7-49e1-92b3-034f7b350cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:31.379156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b149d2-e2d7-49e1-92b3-034f7b350cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:31.379430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b149d2-e2d7-49e1-92b3-034f7b350cc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:31.380636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b149d2-e2d7-49e1-92b3-034f7b350cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:31.382110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b149d2-e2d7-49e1-92b3-034f7b350cc0 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:31.383747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 565/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:31.389475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:31.493177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837fd07-d4ae-4757-86d1-d28753c5dcf7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:31.529422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b43984-b5c2-4385-9218-04cfd4349b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:31.530094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43984-b5c2-4385-9218-04cfd4349b8b None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:31.530377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43984-b5c2-4385-9218-04cfd4349b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:31.530654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43984-b5c2-4385-9218-04cfd4349b8b None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:31.532021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b43984-b5c2-4385-9218-04cfd4349b8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:31.533463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b43984-b5c2-4385-9218-04cfd4349b8b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:31.553480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 545/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:20:31 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:33.813877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0a32-2ff4-4f96-9c3f-bd7b53451fc2 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:33.814413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0a32-2ff4-4f96-9c3f-bd7b53451fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:33.814413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0a32-2ff4-4f96-9c3f-bd7b53451fc2 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:33.815855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 566/1111] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:33.821111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:33.821543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:33.821679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:33.838580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:33.839786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:33.869285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:33.911003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 546/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:33.933975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0a32-2ff4-4f96-9c3f-bd7b53451fc2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:34.036149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0a32-2ff4-4f96-9c3f-bd7b53451fc2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:34.058594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:34.070129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:34.070909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:34.071190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:34.071464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] PATH_INFO: `/v3/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:34.073037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] RBAC: Authorizing `identity:get_role(role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:34.074451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:34.075914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 567/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:33 2022] GET /identity/v3/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:34.082534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:34.184665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a1b1e-b33f-4ee0-a21b-a631d0e704d3 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:34.220154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:34.221026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:34.221309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:34.221586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] PATH_INFO: `/v3/users/06d6d6ee415047d19c41418f9997bcf0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:34.235253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] RBAC: Authorizing `identity:get_user(user_id=06d6d6ee415047d19c41418f9997bcf0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:34.236744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:34.238427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 547/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:34 2022] GET /identity/v3/users/06d6d6ee415047d19c41418f9997bcf0 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:34.244337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:34.342940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bcb79-765b-4ae2-a3fa-b444babf3eba None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:34.376703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:34.377345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:34.377629 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:34.377909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:34.434616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:34.444785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:34.446248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:34.545015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 568/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:34.551362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:34.575970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:34.648536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc88be2-d9d2-44e5-aaff-daa7c36d2f59 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:34.681668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8572a-4d26-4e05-852b-3c660355c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:34.682512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8572a-4d26-4e05-852b-3c660355c446 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:34.682790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8572a-4d26-4e05-852b-3c660355c446 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:34.683062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8572a-4d26-4e05-852b-3c660355c446 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:34.684239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8572a-4d26-4e05-852b-3c660355c446 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0d668dc3f14358990b8972c243a1e0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:34.685673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8572a-4d26-4e05-852b-3c660355c446 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:34.688022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 548/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:34 2022] GET /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:34.694239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:34.783729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:34.792674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d29e78-5e6c-489c-ac4f-efbf474cc1e2 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:34.826772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:34.827412 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:34.827743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:34.828018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:34.828845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] RBAC: Adding query filter params (role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=8d0d668dc3f14358990b8972c243a1e0, user.id=06d6d6ee415047d19c41418f9997bcf0) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:34.829156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:34.830602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514a86-d91d-4371-85da-3f75af9bf399 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:34.836070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 569/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:34 2022] GET /identity/v3/role_assignments?user.id=06d6d6ee415047d19c41418f9997bcf0&scope.project.id=8d0d668dc3f14358990b8972c243a1e0&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:37.011492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7f8bf-441e-47ab-9120-c5e8f2000226 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:37.012054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7f8bf-441e-47ab-9120-c5e8f2000226 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:37.012054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7f8bf-441e-47ab-9120-c5e8f2000226 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:37.013451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 549/1118] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:37.019259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:37.019691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:37.019830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:37.036334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:37.037494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:37.101222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 570/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:37.123473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7f8bf-441e-47ab-9120-c5e8f2000226 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:37.213107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:37.223103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7f8bf-441e-47ab-9120-c5e8f2000226 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:37.258942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:37.259844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:37.260129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:37.260400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] PATH_INFO: `/v3/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:37.261916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] RBAC: Authorizing `identity:get_role(role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:37.263533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:37.265141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 550/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:37 2022] GET /identity/v3/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:37.271388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:37.352525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:37.367661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04885d9e-31e3-46d4-97c4-8317f7b2fd35 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:37.400180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:37.401028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:37.401564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:37.401836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] PATH_INFO: `/v3/users/06d6d6ee415047d19c41418f9997bcf0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:37.402989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] RBAC: Authorizing `identity:get_user(user_id=06d6d6ee415047d19c41418f9997bcf0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:37.404448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:37.406259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 571/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:37 2022] GET /identity/v3/users/06d6d6ee415047d19c41418f9997bcf0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:37.411971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:37.509787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e926-e7f0-49f4-864d-5df527dd9125 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:37.544173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bd6bf-8025-43d3-82c4-7d007ef1e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:37.545034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bd6bf-8025-43d3-82c4-7d007ef1e083 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:37.545320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bd6bf-8025-43d3-82c4-7d007ef1e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:37.545601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bd6bf-8025-43d3-82c4-7d007ef1e083 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:37.547295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bd6bf-8025-43d3-82c4-7d007ef1e083 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0d668dc3f14358990b8972c243a1e0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:37.548779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bd6bf-8025-43d3-82c4-7d007ef1e083 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:37.550486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 551/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:37 2022] GET /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:37.556356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:37.656847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48027f1-f947-4f00-9131-4ebceaeaa02e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:37.689308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5e144-a8f1-47d6-b265-eeb36083dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:37.690187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5e144-a8f1-47d6-b265-eeb36083dfc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:37.690470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5e144-a8f1-47d6-b265-eeb36083dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:37.690748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5e144-a8f1-47d6-b265-eeb36083dfc1 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0/users/06d6d6ee415047d19c41418f9997bcf0/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:37.693084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5e144-a8f1-47d6-b265-eeb36083dfc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d0d668dc3f14358990b8972c243a1e0, user_id=06d6d6ee415047d19c41418f9997bcf0, role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:37.694531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5e144-a8f1-47d6-b265-eeb36083dfc1 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:37.708133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 572/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:20:37 2022] PUT /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0/users/06d6d6ee415047d19c41418f9997bcf0/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:20:39.905147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11b3da-a042-4b05-b2be-31c0ef3142bf None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:39.905573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11b3da-a042-4b05-b2be-31c0ef3142bf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:39.906262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11b3da-a042-4b05-b2be-31c0ef3142bf None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:39.907668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 552/1124] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:39.913029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:39.913470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:39.913595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:39.930747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:39.931992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:39.941207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:39.997515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 573/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:40.021509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11b3da-a042-4b05-b2be-31c0ef3142bf None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:40.048684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:40.119366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11b3da-a042-4b05-b2be-31c0ef3142bf None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:40.152189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:40.152967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:40.153246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:40.153519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] PATH_INFO: `/v3/roles/9bc24fb385794c3ebfa856c00f8f5597` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:40.154956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] RBAC: Authorizing `identity:get_role(role_id=9bc24fb385794c3ebfa856c00f8f5597)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:40.156368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:40.157707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 553/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:40 2022] GET /identity/v3/roles/9bc24fb385794c3ebfa856c00f8f5597 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:40.163372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:40.257994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62520-53c8-4474-8ea9-5815821bbaf4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:40.291080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:40.291955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:40.292234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:40.292506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] PATH_INFO: `/v3/users/06d6d6ee415047d19c41418f9997bcf0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:40.293670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] RBAC: Authorizing `identity:get_user(user_id=06d6d6ee415047d19c41418f9997bcf0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:40.295103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:40.296765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 574/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:40 2022] GET /identity/v3/users/06d6d6ee415047d19c41418f9997bcf0 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:40.302467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:40.401549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:40.408161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb084b3-f807-47ff-a06a-dc97f72a832b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:40.442492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:40.443136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:40.443420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:40.443800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:40.509247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:40.510719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:40.603056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:40.610332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 554/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:40.616264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:40.631356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:40.715015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40640f9-dfb6-4cbc-b4f6-f70e21e02421 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:40.749568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9502c0a-24af-4eff-88e2-c8b374870742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:40.750413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502c0a-24af-4eff-88e2-c8b374870742 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:40.750694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502c0a-24af-4eff-88e2-c8b374870742 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:40.750969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502c0a-24af-4eff-88e2-c8b374870742 None admin] PATH_INFO: `/v3/projects/8d0d668dc3f14358990b8972c243a1e0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:40.752162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9502c0a-24af-4eff-88e2-c8b374870742 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0d668dc3f14358990b8972c243a1e0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:40.753609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9502c0a-24af-4eff-88e2-c8b374870742 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:40.755313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 575/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:40 2022] GET /identity/v3/projects/8d0d668dc3f14358990b8972c243a1e0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:40.761390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:40.861527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358845a-74b8-40da-a9e4-326cb0ba44c5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:40.895247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:40.895945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:40.896223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:40.896495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:40.897330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] RBAC: Adding query filter params (role.id=9bc24fb385794c3ebfa856c00f8f5597, scope.project.id=8d0d668dc3f14358990b8972c243a1e0, user.id=06d6d6ee415047d19c41418f9997bcf0) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:40.897640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:40.899072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8776-623f-4a59-a2b1-18613e604d75 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:40.906170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 555/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:40 2022] GET /identity/v3/role_assignments?user.id=06d6d6ee415047d19c41418f9997bcf0&scope.project.id=8d0d668dc3f14358990b8972c243a1e0&role.id=9bc24fb385794c3ebfa856c00f8f5597 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:43.188001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b641f8-afa1-459d-a1f4-a2cede48c5cb None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:43.188530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b641f8-afa1-459d-a1f4-a2cede48c5cb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:43.188530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b641f8-afa1-459d-a1f4-a2cede48c5cb None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:43.189951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 576/1131] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:43.195251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:43.195665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:43.195848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:43.213387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:43.214595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:43.275744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:43.291773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 556/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:43.316743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b641f8-afa1-459d-a1f4-a2cede48c5cb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:43.405112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:43.426258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b641f8-afa1-459d-a1f4-a2cede48c5cb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:43.460959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413f442-7cd1-48cf-a3e2-0ff53e57d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:43.461666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413f442-7cd1-48cf-a3e2-0ff53e57d703 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:43.461953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413f442-7cd1-48cf-a3e2-0ff53e57d703 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:43.462228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413f442-7cd1-48cf-a3e2-0ff53e57d703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:43.463398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413f442-7cd1-48cf-a3e2-0ff53e57d703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:43.464879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413f442-7cd1-48cf-a3e2-0ff53e57d703 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:43.466512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 577/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:43.472969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:43.568709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82be75-a4d6-4f6c-8082-d20e8959e62c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:43.603699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013db0a-67e1-4419-93c7-6bcb93261edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:43.604365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013db0a-67e1-4419-93c7-6bcb93261edc None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:43.604649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013db0a-67e1-4419-93c7-6bcb93261edc None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:43.604927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013db0a-67e1-4419-93c7-6bcb93261edc None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:43.605641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013db0a-67e1-4419-93c7-6bcb93261edc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:43.607088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013db0a-67e1-4419-93c7-6bcb93261edc None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:43.644354 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 557/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:20:43 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:45.896300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c005-b849-4eee-aab0-915e43107d27 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:45.896682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c005-b849-4eee-aab0-915e43107d27 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:45.896861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c005-b849-4eee-aab0-915e43107d27 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:45.898243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 578/1135] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:45.903879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:45.904336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:45.904431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:45.921926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:45.923096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:45.957265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:45.990097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 558/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:20:46.015550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c005-b849-4eee-aab0-915e43107d27 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:46.114921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c005-b849-4eee-aab0-915e43107d27 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:46.148648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0abf99-04ff-49a6-acb4-cc6b38ef5bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:46.149350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0abf99-04ff-49a6-acb4-cc6b38ef5bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:46.149628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0abf99-04ff-49a6-acb4-cc6b38ef5bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:46.149895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0abf99-04ff-49a6-acb4-cc6b38ef5bd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:46.151311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0abf99-04ff-49a6-acb4-cc6b38ef5bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:46.152788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0abf99-04ff-49a6-acb4-cc6b38ef5bd3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:46.154409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 579/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:20:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:46.160266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:46.255357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656de178-61e1-4409-a2be-ccfd9c066b29 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:46.288589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb2e2a-383e-4672-ba07-a6e4239498aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:46.289251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb2e2a-383e-4672-ba07-a6e4239498aa None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:46.289531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb2e2a-383e-4672-ba07-a6e4239498aa None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:46.289805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb2e2a-383e-4672-ba07-a6e4239498aa None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:46.290512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb2e2a-383e-4672-ba07-a6e4239498aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:46.291981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb2e2a-383e-4672-ba07-a6e4239498aa None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:46.311371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 559/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:20:46 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:20:48.593946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5f724-10b6-4072-8929-3fb8e286f458 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:48.594485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5f724-10b6-4072-8929-3fb8e286f458 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:48.594485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5f724-10b6-4072-8929-3fb8e286f458 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:48.595893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 580/1139] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:48.601512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:48.601971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:48.602074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:48.619187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:48.620416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:48.644456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:48.691362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 560/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:48.715033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5f724-10b6-4072-8929-3fb8e286f458 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:48.733917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:48.817494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5f724-10b6-4072-8929-3fb8e286f458 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:48.855036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:48.855787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:48.856068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:48.856339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:48.866754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:48.874901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:48.876053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:48.877261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 581/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:48.882151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:48.978162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d61a4-ff84-4464-acbf-eb3a605c98dc None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:49.011590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:49.012278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:49.012558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:49.012831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:49.013566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:49.013871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:49.015260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:49.023198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 561/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:49.029236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:49.121127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:49.144321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653785c-04d6-435f-b497-e182a750fd07 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:49.178556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:49.179428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:49.179741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:49.180046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] PATH_INFO: `/v3/users/95bc845415654a818f19b12d76a16f3a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:49.193066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] RBAC: Authorizing `identity:get_user(user_id=95bc845415654a818f19b12d76a16f3a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:49.194545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:49.196259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 582/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:49 2022] GET /identity/v3/users/95bc845415654a818f19b12d76a16f3a => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:49.201978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:49.224533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:49.302029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e987-b496-4096-9f92-3f35dba3fce8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:49.340676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:49.341327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:49.341609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:49.341883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:49.408614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:49.410077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:49.430692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:49.507631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 562/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:49.513520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:49.611090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2659a9-5279-4f24-98eb-834b0770d585 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:49.644301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205264-515a-407c-9027-b604fc23f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:49.645146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205264-515a-407c-9027-b604fc23f976 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:49.645423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205264-515a-407c-9027-b604fc23f976 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:49.645692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205264-515a-407c-9027-b604fc23f976 None admin] PATH_INFO: `/v3/projects/b428059526d54f3b976415348eb73156` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:49.646869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205264-515a-407c-9027-b604fc23f976 None admin] RBAC: Authorizing `identity:get_project(project_id=b428059526d54f3b976415348eb73156)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:49.648340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205264-515a-407c-9027-b604fc23f976 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:49.650045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 583/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:49 2022] GET /identity/v3/projects/b428059526d54f3b976415348eb73156 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:49.656559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:49.755014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ab4d-65cf-49b7-9f55-1b479585b292 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:49.774418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:49.789189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:49.789852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:49.790137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:49.790415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:49.791248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b428059526d54f3b976415348eb73156, user.id=95bc845415654a818f19b12d76a16f3a) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:49.791565 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:49.793035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b795400-f7e6-4741-a0dc-5de07c7a7665 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:49.799298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 563/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:49 2022] GET /identity/v3/role_assignments?user.id=95bc845415654a818f19b12d76a16f3a&scope.project.id=b428059526d54f3b976415348eb73156&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:52.003876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023c81a-e8f1-4308-997c-fe2f0fe4dcfd None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.004462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023c81a-e8f1-4308-997c-fe2f0fe4dcfd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.004462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023c81a-e8f1-4308-997c-fe2f0fe4dcfd None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.005774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 584/1147] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:52.010884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.011290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.011447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.028832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:52.030021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:52.096179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 564/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:52.117930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023c81a-e8f1-4308-997c-fe2f0fe4dcfd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:52.120875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:52.218156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023c81a-e8f1-4308-997c-fe2f0fe4dcfd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:52.250973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:52.251775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.252056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.252326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.262153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:52.270425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:52.271685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:52.272822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:52.276894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 585/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:52.277960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:52.380548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cc8cc-35fb-4b28-9844-6094127ee57e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:52.394646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:52.414437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:52.415096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.415380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.415682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.416428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:52.416739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:52.418116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:52.426461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 565/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:20:52.432360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:52.492073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:52.531074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468692d3-c048-4196-a034-c52bca7f0f1f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:52.564149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:52.565011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.565299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.565576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] PATH_INFO: `/v3/users/95bc845415654a818f19b12d76a16f3a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.566753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] RBAC: Authorizing `identity:get_user(user_id=95bc845415654a818f19b12d76a16f3a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:52.568242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:52.569863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 586/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:52 2022] GET /identity/v3/users/95bc845415654a818f19b12d76a16f3a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:52.575572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:52.673450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf8507-8b5a-4aa2-8f9c-54b7969f79d5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:52.706477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec80ed-5977-44a3-9b1a-8355fb177508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:52.707327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec80ed-5977-44a3-9b1a-8355fb177508 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.707611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec80ed-5977-44a3-9b1a-8355fb177508 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.707914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec80ed-5977-44a3-9b1a-8355fb177508 None admin] PATH_INFO: `/v3/projects/b428059526d54f3b976415348eb73156` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.709087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec80ed-5977-44a3-9b1a-8355fb177508 None admin] RBAC: Authorizing `identity:get_project(project_id=b428059526d54f3b976415348eb73156)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:52.710526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec80ed-5977-44a3-9b1a-8355fb177508 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:52.712242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 566/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:52 2022] GET /identity/v3/projects/b428059526d54f3b976415348eb73156 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:52.718796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:52.821040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c113-2fc9-4aba-af34-9f65601f1b20 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:52.849031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:52.855191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3390a46-debe-43c5-bf74-4db58403633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:52.856162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3390a46-debe-43c5-bf74-4db58403633b None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:52.856471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3390a46-debe-43c5-bf74-4db58403633b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:52.856748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3390a46-debe-43c5-bf74-4db58403633b None admin] PATH_INFO: `/v3/projects/b428059526d54f3b976415348eb73156/users/95bc845415654a818f19b12d76a16f3a/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:52.858740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3390a46-debe-43c5-bf74-4db58403633b None admin] RBAC: Authorizing `identity:create_grant(project_id=b428059526d54f3b976415348eb73156, user_id=95bc845415654a818f19b12d76a16f3a, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:52.860217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3390a46-debe-43c5-bf74-4db58403633b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:52.873417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 587/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:20:52 2022] PUT /identity/v3/projects/b428059526d54f3b976415348eb73156/users/95bc845415654a818f19b12d76a16f3a/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:20:55.050642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee7dfd-8d76-4111-8c66-72e42e40151c None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:55.051194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee7dfd-8d76-4111-8c66-72e42e40151c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:55.051194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee7dfd-8d76-4111-8c66-72e42e40151c None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:55.052609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 567/1154] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:55.057928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:55.058342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:55.058489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:55.075006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:55.076228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:55.141377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 588/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:55.165125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee7dfd-8d76-4111-8c66-72e42e40151c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:55.210952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:55.264012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee7dfd-8d76-4111-8c66-72e42e40151c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:55.296960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:55.297732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:55.298012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:55.298284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:55.308429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:20:55.315898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:55.316820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:20:55.317678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 568/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:55.323015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:55.422374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00030b5e-0fd3-491c-b8ed-27b194ef2ddf None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:55.443631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:55.459637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:55.460335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:55.460621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:55.460899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:55.461666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:55.461973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:55.463383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:55.473094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 589/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:55.479244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:55.583205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bd2f2-d129-490f-8125-54866c50c2ac None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:55.585581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:55.618191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:55.619044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:55.619329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:55.619599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] PATH_INFO: `/v3/users/95bc845415654a818f19b12d76a16f3a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:55.620810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] RBAC: Authorizing `identity:get_user(user_id=95bc845415654a818f19b12d76a16f3a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:55.622250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:55.623949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 569/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:20:55 2022] GET /identity/v3/users/95bc845415654a818f19b12d76a16f3a => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:55.629772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:55.728785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21811-d442-457b-bae0-a09206567970 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:55.761947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:55.762592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:55.762873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:55.763147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:55.812224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:55.831121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:55.832633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:55.929110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 590/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:55.935059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:56.031371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6bab-47c1-480c-a29b-7b2fada22c8a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:56.063975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19002377-1acb-460e-a0e5-4ef5a363d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:56.064826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002377-1acb-460e-a0e5-4ef5a363d655 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:56.065111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002377-1acb-460e-a0e5-4ef5a363d655 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:56.065383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002377-1acb-460e-a0e5-4ef5a363d655 None admin] PATH_INFO: `/v3/projects/b428059526d54f3b976415348eb73156` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:56.066556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19002377-1acb-460e-a0e5-4ef5a363d655 None admin] RBAC: Authorizing `identity:get_project(project_id=b428059526d54f3b976415348eb73156)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:56.068044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19002377-1acb-460e-a0e5-4ef5a363d655 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:56.069743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 570/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:20:55 2022] GET /identity/v3/projects/b428059526d54f3b976415348eb73156 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:56.075830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:56.154167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:56.172600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631234-872c-403a-8b5e-b5fbd2b280c9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:56.205484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:56.206125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:56.206403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:56.206674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:56.207493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b428059526d54f3b976415348eb73156, user.id=95bc845415654a818f19b12d76a16f3a) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:56.207828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:56.209261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48448b-b0b2-450c-928f-2e21c8cac177 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:56.214973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 591/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:20:56 2022] GET /identity/v3/role_assignments?user.id=95bc845415654a818f19b12d76a16f3a&scope.project.id=b428059526d54f3b976415348eb73156&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:20:58.445380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ebef5-b2e3-487f-904a-0657e2406fa7 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:58.446053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ebef5-b2e3-487f-904a-0657e2406fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:58.446053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ebef5-b2e3-487f-904a-0657e2406fa7 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:58.447305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 571/1162] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:20:58.452592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:58.453012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:58.453152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:58.469550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:20:58.470743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:20:58.544447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 592/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:20:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:20:58.567884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ebef5-b2e3-487f-904a-0657e2406fa7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:58.609555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:58.667161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ebef5-b2e3-487f-904a-0657e2406fa7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:58.701204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:58.701802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:58.702085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:58.702361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:58.766665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:58.768139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:58.823412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:58.881980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 572/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:20:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:20:58.888003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:58.965254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:20:58.988833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595de67-d8d9-459d-834a-7e768c9aec91 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:59.024997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:59.026063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:59.026344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:59.026619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:59.033415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:59.034883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-0f4df42b-f31c-4a95-9044-13dbd84a51ea None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:20:59.049823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:20:59.050910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:20:59.051991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 593/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:20:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:20:59.057119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:20:59.160001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c764-3a27-452e-a474-7dcaa9ecca76 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:20:59.194066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:20:59.194744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:20:59.195027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:20:59.195309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:20:59.196064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:20:59.196373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:20:59.197748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1624-ccfc-4c21-ae31-830109ff5b5f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:20:59.205060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 573/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Thu May 19 16:20:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:01.430463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773797-6de8-4d8c-a249-08dad239d713 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:01.431005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773797-6de8-4d8c-a249-08dad239d713 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:01.431005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773797-6de8-4d8c-a249-08dad239d713 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:01.432426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 594/1167] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:21:01.438170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55f7f-cda8-41f2-a835-8eb460acccad None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:01.438607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55f7f-cda8-41f2-a835-8eb460acccad None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:01.438741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55f7f-cda8-41f2-a835-8eb460acccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:01.444682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:01.456489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-3da55f7f-cda8-41f2-a835-8eb460acccad None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:21:01.457678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3da55f7f-cda8-41f2-a835-8eb460acccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:21:01.522540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 574/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:21:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:21:01.545234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773797-6de8-4d8c-a249-08dad239d713 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:01.644800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773797-6de8-4d8c-a249-08dad239d713 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:01.676809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70170e2-1cb0-49e5-9a61-695e33c99d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:01.677450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70170e2-1cb0-49e5-9a61-695e33c99d60 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:01.677731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70170e2-1cb0-49e5-9a61-695e33c99d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:01.678005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70170e2-1cb0-49e5-9a61-695e33c99d60 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:01.678745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70170e2-1cb0-49e5-9a61-695e33c99d60 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:01.680148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70170e2-1cb0-49e5-9a61-695e33c99d60 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:01.683562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:01.695668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 595/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Thu May 19 16:21:01 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:21:03.932653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497410-6601-4451-8683-ec3437178bea None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:03.933168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497410-6601-4451-8683-ec3437178bea None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:03.933270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497410-6601-4451-8683-ec3437178bea None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:03.934584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 575/1170] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:21:03.940605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:03.941044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:03.941131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:03.957969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:21:03.959138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:21:04.023327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 596/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:21:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:21:04.046808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497410-6601-4451-8683-ec3437178bea None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:04.145878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497410-6601-4451-8683-ec3437178bea None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:04.183019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c76301-9967-4289-977b-cd7f731ec8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:04.183908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c76301-9967-4289-977b-cd7f731ec8bd None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:04.184194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c76301-9967-4289-977b-cd7f731ec8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:04.184475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c76301-9967-4289-977b-cd7f731ec8bd None admin] PATH_INFO: `/v3/domains/f2e9f2373f47412cbb4930a274e30fbb` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:04.187043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:04.196346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c76301-9967-4289-977b-cd7f731ec8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=f2e9f2373f47412cbb4930a274e30fbb)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:04.197802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c76301-9967-4289-977b-cd7f731ec8bd None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:04.199482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 576/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Thu May 19 16:21:04 2022] GET /identity/v3/domains/f2e9f2373f47412cbb4930a274e30fbb => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:04.205399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:04.301080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a469-7e04-44ab-8240-4076b6257d81 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:04.326304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:04.335241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbfb22-b6f0-46a7-9c4e-21f5a823784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:04.335934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbfb22-b6f0-46a7-9c4e-21f5a823784d None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:04.336216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbfb22-b6f0-46a7-9c4e-21f5a823784d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:04.336491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbfb22-b6f0-46a7-9c4e-21f5a823784d None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:04.337198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbfb22-b6f0-46a7-9c4e-21f5a823784d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:04.338634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbfb22-b6f0-46a7-9c4e-21f5a823784d None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:04.362797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 597/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:21:04 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:21:06.611697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8b06-142e-4668-9cd0-afd4f8180f21 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:06.612248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8b06-142e-4668-9cd0-afd4f8180f21 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:06.612248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8b06-142e-4668-9cd0-afd4f8180f21 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:06.613623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 577/1174] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:21:06.618761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:06.619143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:06.619322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:06.636304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:21:06.637489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:21:06.702976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 598/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:21:06.727230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8b06-142e-4668-9cd0-afd4f8180f21 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:06.825848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8b06-142e-4668-9cd0-afd4f8180f21 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:06.858105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7c8fe-cb0e-4f02-8539-b4daeeeab990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:06.858959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7c8fe-cb0e-4f02-8539-b4daeeeab990 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:06.859242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7c8fe-cb0e-4f02-8539-b4daeeeab990 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:06.859518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7c8fe-cb0e-4f02-8539-b4daeeeab990 None admin] PATH_INFO: `/v3/domains/f2e9f2373f47412cbb4930a274e30fbb` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:06.860718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7c8fe-cb0e-4f02-8539-b4daeeeab990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f2e9f2373f47412cbb4930a274e30fbb)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:06.862202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7c8fe-cb0e-4f02-8539-b4daeeeab990 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:06.863801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 578/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Thu May 19 16:21:06 2022] GET /identity/v3/domains/f2e9f2373f47412cbb4930a274e30fbb => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:06.869469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:06.967218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4f9e-90f6-44d8-ad7a-cc6480314135 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:06.977608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:07.003282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674201-b591-4d20-b0dc-ea4f635a3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:07.003984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674201-b591-4d20-b0dc-ea4f635a3823 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:07.004267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674201-b591-4d20-b0dc-ea4f635a3823 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:07.004543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674201-b591-4d20-b0dc-ea4f635a3823 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:07.005263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674201-b591-4d20-b0dc-ea4f635a3823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:07.006716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674201-b591-4d20-b0dc-ea4f635a3823 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:07.027238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 599/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:21:06 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:21:09.275833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a0d0-b4fa-4e68-b42d-2f94591d4298 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:09.276337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a0d0-b4fa-4e68-b42d-2f94591d4298 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:09.276337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a0d0-b4fa-4e68-b42d-2f94591d4298 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:09.277685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 579/1178] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:21:09.284038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:09.284454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:09.284600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:09.301055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:21:09.302236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:21:09.366854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 600/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:21:09.390425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668a0d0-b4fa-4e68-b42d-2f94591d4298 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:09.452714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:09.491662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668a0d0-b4fa-4e68-b42d-2f94591d4298 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:09.524092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:09.524881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:09.525174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:09.525710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:09.536789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:21:09.544306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:21:09.545429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:21:09.546315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 580/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:21:09.551643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:09.643082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:09.650851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d204fb-48d9-42af-9962-cfa439b0524e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:09.683798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:09.684458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:09.684742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:09.685018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:09.686293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:21:09.686602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:09.688015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:09.695907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 601/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:09.702289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:09.798080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f4953-f5f5-4f66-9891-1bd6090af481 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:09.820067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:09.832114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:09.832971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:09.833251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:09.833525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] PATH_INFO: `/v3/users/2f5c8fa2c8044548a38538d5e831ec88` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:09.846422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=2f5c8fa2c8044548a38538d5e831ec88)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:09.847894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:09.849550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 581/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:21:09 2022] GET /identity/v3/users/2f5c8fa2c8044548a38538d5e831ec88 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:09.855237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:09.955050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5bb99-694c-466b-8d08-a77a8fe2d65f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:09.989609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:09.990256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:09.990540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:09.990822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:10.015562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:10.058253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:10.059658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:10.161115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 602/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:21:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:21:10.167036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:10.263297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666533ac-6326-476b-b718-ec9e511a5ac6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:10.296249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e23ff9-7f31-432c-acd8-5c3dd3ae3d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:10.297094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23ff9-7f31-432c-acd8-5c3dd3ae3d0f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:10.297376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23ff9-7f31-432c-acd8-5c3dd3ae3d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:10.297651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23ff9-7f31-432c-acd8-5c3dd3ae3d0f None admin] PATH_INFO: `/v3/projects/4aaffa78ff3345f6ae06e3d991abd788` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:10.298815 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e23ff9-7f31-432c-acd8-5c3dd3ae3d0f None admin] RBAC: Authorizing `identity:get_project(project_id=4aaffa78ff3345f6ae06e3d991abd788)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:10.300288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e23ff9-7f31-432c-acd8-5c3dd3ae3d0f None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:10.301946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 582/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:21:10 2022] GET /identity/v3/projects/4aaffa78ff3345f6ae06e3d991abd788 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:10.308060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:10.362527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:10.406140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d97b-ecd7-4139-84db-895ca4a89925 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:10.439047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:10.439723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:10.440009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:10.440282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:10.441112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=4aaffa78ff3345f6ae06e3d991abd788, user.id=2f5c8fa2c8044548a38538d5e831ec88) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:21:10.441424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:10.442871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf314b2-4113-4b7e-8e26-440f9232daf2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:10.448259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 603/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:21:10 2022] GET /identity/v3/role_assignments?user.id=2f5c8fa2c8044548a38538d5e831ec88&scope.project.id=4aaffa78ff3345f6ae06e3d991abd788&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:12.636427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b7b3-25b7-410f-b009-8862f2e9b1a7 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:12.637006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b7b3-25b7-410f-b009-8862f2e9b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:12.637006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b7b3-25b7-410f-b009-8862f2e9b1a7 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:12.638348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 583/1186] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:21:12.644178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:12.644617 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:12.644736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:12.661449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:21:12.662639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:21:12.729415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 604/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:21:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:21:12.752339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240b7b3-25b7-410f-b009-8862f2e9b1a7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:12.802010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:12.854128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240b7b3-25b7-410f-b009-8862f2e9b1a7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:12.887492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:12.888234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:12.888594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:12.889355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:12.899733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:21:12.907681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:21:12.908795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:21:12.914864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 584/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:21:12.915735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:12.964135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:13.013806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f426c95-a817-4fc1-9125-724b306a51bb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:13.049118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:13.050261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:13.050781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:13.051284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:13.052738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:21:13.053324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:13.054848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:13.064209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 605/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:13.072049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:13.172236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4030-47be-450a-b2a5-ba26298398c5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:13.181135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:13.206860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:13.207745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:13.208031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:13.208340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] PATH_INFO: `/v3/users/2f5c8fa2c8044548a38538d5e831ec88` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:13.209568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] RBAC: Authorizing `identity:get_user(user_id=2f5c8fa2c8044548a38538d5e831ec88)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:13.211016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:13.213139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 585/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:21:13 2022] GET /identity/v3/users/2f5c8fa2c8044548a38538d5e831ec88 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:13.219018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:13.318155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3939-af77-4da8-a386-3805d66515ef None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:13.330793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:13.351493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045bf7f-bf1c-4e95-bf0b-6b8db722d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:13.352387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045bf7f-bf1c-4e95-bf0b-6b8db722d7ed None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:13.352671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045bf7f-bf1c-4e95-bf0b-6b8db722d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:13.352949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045bf7f-bf1c-4e95-bf0b-6b8db722d7ed None admin] PATH_INFO: `/v3/projects/4aaffa78ff3345f6ae06e3d991abd788` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:13.354125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045bf7f-bf1c-4e95-bf0b-6b8db722d7ed None admin] RBAC: Authorizing `identity:get_project(project_id=4aaffa78ff3345f6ae06e3d991abd788)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:13.355588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045bf7f-bf1c-4e95-bf0b-6b8db722d7ed None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:13.357858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 606/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:21:13 2022] GET /identity/v3/projects/4aaffa78ff3345f6ae06e3d991abd788 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:13.363777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:13.463525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7e93-6136-4893-ba96-a03b9ba84af5 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:13.496884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2e05b-5cc1-4d2f-93bc-fe66f71a11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:13.497769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e05b-5cc1-4d2f-93bc-fe66f71a11d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:13.498078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e05b-5cc1-4d2f-93bc-fe66f71a11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:13.498355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e05b-5cc1-4d2f-93bc-fe66f71a11d5 None admin] PATH_INFO: `/v3/projects/4aaffa78ff3345f6ae06e3d991abd788/users/2f5c8fa2c8044548a38538d5e831ec88/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:13.500306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2e05b-5cc1-4d2f-93bc-fe66f71a11d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4aaffa78ff3345f6ae06e3d991abd788, user_id=2f5c8fa2c8044548a38538d5e831ec88, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:13.501742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2e05b-5cc1-4d2f-93bc-fe66f71a11d5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:13.514341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 586/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:21:13 2022] PUT /identity/v3/projects/4aaffa78ff3345f6ae06e3d991abd788/users/2f5c8fa2c8044548a38538d5e831ec88/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:21:15.723588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc5a3-45ff-4cc0-af5a-87fc0163859c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:15.724162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc5a3-45ff-4cc0-af5a-87fc0163859c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:15.724162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc5a3-45ff-4cc0-af5a-87fc0163859c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:15.725557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 607/1193] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:21:15.730813 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:15.731210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:15.731375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:15.748261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:21:15.749442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:21:15.777754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:15.816086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 587/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:21:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:21:15.839926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc5a3-45ff-4cc0-af5a-87fc0163859c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:15.941023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc5a3-45ff-4cc0-af5a-87fc0163859c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:15.973407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:15.974230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:15.974455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:15.974720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:15.985477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:21:15.992961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:21:15.994021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:21:15.995113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 608/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:21:16.001013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:16.097279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e1b3-d603-43ee-a2b9-9feb7ea9e648 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:16.131059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:16.131752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:16.132042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:16.132325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:16.133076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:21:16.133389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:16.134768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:16.142981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 588/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:16.148719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:16.190347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:16.247027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6686-bca1-4343-9aeb-867922b1569d None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:16.279885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:16.280743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:16.281019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:16.281289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] PATH_INFO: `/v3/users/2f5c8fa2c8044548a38538d5e831ec88` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:16.282450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] RBAC: Authorizing `identity:get_user(user_id=2f5c8fa2c8044548a38538d5e831ec88)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:16.283935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:16.285556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 609/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu May 19 16:21:16 2022] GET /identity/v3/users/2f5c8fa2c8044548a38538d5e831ec88 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:16.291277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:16.320239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:16.389857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2734eed-8717-4b83-9a30-3d2f008e293e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:16.425054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:16.425704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:16.425991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:16.426273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:16.491362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:16.493028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:16.518979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:16.589474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 589/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:21:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:21:16.595847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:16.692135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0116-0408-4ec4-90d4-431d78432edb None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:16.701015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:16.725526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065ba86-0888-4268-899a-d690c1e0a5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:16.726381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ba86-0888-4268-899a-d690c1e0a5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:16.726666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ba86-0888-4268-899a-d690c1e0a5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:16.726942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ba86-0888-4268-899a-d690c1e0a5d9 None admin] PATH_INFO: `/v3/projects/4aaffa78ff3345f6ae06e3d991abd788` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:16.728131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065ba86-0888-4268-899a-d690c1e0a5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=4aaffa78ff3345f6ae06e3d991abd788)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:16.729575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065ba86-0888-4268-899a-d690c1e0a5d9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:16.731269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 610/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Thu May 19 16:21:16 2022] GET /identity/v3/projects/4aaffa78ff3345f6ae06e3d991abd788 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:16.737996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:21:16.832942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad462-f9dd-4b77-a811-dfc4f65f356e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:21:16.859340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:16.868526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:21:16.869172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:21:16.869459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:21:16.869739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:21:16.870570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=4aaffa78ff3345f6ae06e3d991abd788, user.id=2f5c8fa2c8044548a38538d5e831ec88) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:21:16.870887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:21:16.872355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2ed6-ff38-41c1-aa03-4a950725bd30 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:21:16.878110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 590/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:21:16 2022] GET /identity/v3/role_assignments?user.id=2f5c8fa2c8044548a38538d5e831ec88&scope.project.id=4aaffa78ff3345f6ae06e3d991abd788&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:21:26.721467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=12 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:21:26.875512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:17.447127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017004b-5597-42d3-9d46-eae53c379fd1 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:17.447127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017004b-5597-42d3-9d46-eae53c379fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:17.447127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017004b-5597-42d3-9d46-eae53c379fd1 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:17.447127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 611/1201] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:17.453421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:17.453913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:17.454167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:17.474066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:17.475422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:17.578609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 591/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:22:17.604184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017004b-5597-42d3-9d46-eae53c379fd1 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:17.744910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017004b-5597-42d3-9d46-eae53c379fd1 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:17.792534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:17.793547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:17.793832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:17.794158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:17.810679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:17.812788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:17.835045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:17.836215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:17.837232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:17.837232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:17.837232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:17.837232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:17.837232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 612/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:17.842601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:17.987695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf556e-5c3c-4371-96ba-49610e38a7ec None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:18.021201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:18.032081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:18.032690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:18.032974 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:18.033251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:18.033981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:18.034294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:18.035693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f55c3-7960-4672-b03f-3dae8e8b3b68 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:18.049916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 592/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:18.055767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:18.127082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:18.183313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d96604-4f00-41c0-9bec-143e5d29be07 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:18.229245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ee87-5ff9-41ec-b3b7-cf4afda8b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:18.230480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ee87-5ff9-41ec-b3b7-cf4afda8b6ad None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:18.230766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ee87-5ff9-41ec-b3b7-cf4afda8b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:18.231100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ee87-5ff9-41ec-b3b7-cf4afda8b6ad None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:18.231797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ee87-5ff9-41ec-b3b7-cf4afda8b6ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:18.233265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ee87-5ff9-41ec-b3b7-cf4afda8b6ad None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:18.257820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 613/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Thu May 19 16:22:18 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:22:20.732959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7058d8b-5c7d-419b-bac3-a1bc973cdacf None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:20.733559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7058d8b-5c7d-419b-bac3-a1bc973cdacf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:20.733559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7058d8b-5c7d-419b-bac3-a1bc973cdacf None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:20.734876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 593/1206] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:20.740520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:20.741005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:20.741120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:20.760543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:20.761823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:20.844760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 614/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:20.866255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7058d8b-5c7d-419b-bac3-a1bc973cdacf None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:20.997322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7058d8b-5c7d-419b-bac3-a1bc973cdacf None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:21.038049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:21.038860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:21.039141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:21.039426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:21.052088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:22:21.060122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:21.061149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:21.062005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 594/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:22:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:21.067361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:21.116581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:21.205074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c755d-1c10-404d-8050-97a861d2193e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:21.246493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:21.247171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:21.247505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:21.247759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:21.248516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:21.248830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:21.250248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:21.263648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 615/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:21.267130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:21.331196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:21.392448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df21362-0dd1-4b26-a4a2-ca5fa938edf3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:21.438041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:21.439149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:21.439496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:21.440014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:21.454501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:21.456693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:21.477278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:21.478257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:21.479156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:21.479156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:21.479156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:21.479156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:21.480922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 595/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:21.486957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:21.615774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:21.618387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3488be-efac-451e-a2bc-a65c859276bf None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:21.663745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:21.664948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:21.665249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:21.665591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:21.666365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:21.666683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:21.668346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:21.686190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 616/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:22:21.691937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:21.815968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9b9f6-e988-48e2-82b6-6eaf5c9b0ee2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:21.817721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:21.858669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:21.860029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:21.860518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:21.861100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:21.872457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:21.873489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:22:21.893448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:21.894566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:21.895917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:21.900695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 596/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:21.902664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:22.030525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2bb02-b2ea-49a1-9f49-32d59654234e None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:22.069661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:22.070371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:22.070652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:22.070930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:22.071898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:22.072209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:22.073697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:22.092907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 617/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 19 16:22:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:22.099144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:22.219056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda306-1f2b-4afc-8032-55c6e3532500 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:22.261660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:22.262324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:22.262617 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:22.262978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:22.302678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:22.363143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:22.364845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:22.473879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 597/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:22:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:22:22.479929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:22.503175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:22.612267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c99e83-390a-4182-a9a2-9fcce6816991 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:22.662025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:22.662938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:22.663436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:22.663820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:22.677125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:22.678601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:22.707788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:22.708810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:22.715382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:22.715382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:22.715382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:22.715382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:22.715382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 618/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:22.715816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:22.787984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:22.832432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e29b-3578-4143-a696-9e0382d433b3 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:22.869860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:22.871099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:22.871383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:22.871683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:22.872413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:22.872852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:22.874400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:22.887977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 598/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:22.893873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:22.990896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:23.030814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73928584-2c0b-4433-8b49-872ba99c9146 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:23.074450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:23.075399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:23.075827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:23.076728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:23.084799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:23.086759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:22:23.102498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:23.103827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:23.105389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 619/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:23.110534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:23.231015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3bb61-88ae-4111-95e3-304e66110835 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:23.257725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:23.271205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:23.271899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:23.272182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:23.272456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:23.273243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:23.273811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:23.275267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229aa56f-0bbb-4a79-b418-963ca6b7c5d5 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:23.289035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 599/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:23.295825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:23.417873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db374-e54e-48ae-944a-9e9d061e1f4a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:23.455405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:23.462108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:23.462763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:23.463043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:23.463315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:23.464795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=0610a73cbaf54e21a63a0469ceb9c856) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:23.465275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:23.467113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9abb3-a5fc-4371-b58f-964f5a3177e9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:23.475325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 620/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:22:23 2022] GET /identity/v3/role_assignments?user.id=0610a73cbaf54e21a63a0469ceb9c856&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:25.790973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a75d-81d7-4625-a0a4-dc7fc2ba5359 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:25.790973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a75d-81d7-4625-a0a4-dc7fc2ba5359 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:25.790973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a75d-81d7-4625-a0a4-dc7fc2ba5359 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:25.793217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 600/1220] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:25.798619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:25.801061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:25.801061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:25.820830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:25.822033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:25.907655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 621/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:25.928508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a75d-81d7-4625-a0a4-dc7fc2ba5359 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:26.055118 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a75d-81d7-4625-a0a4-dc7fc2ba5359 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:26.094412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:26.095362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:26.095707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:26.095986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:26.108865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:22:26.118732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:26.120558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:26.122108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 601/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:22:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:26.126846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:26.231454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad217987-bf7c-4a9b-a4f2-f1a73797b541 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:26.257895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:26.271236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:26.271988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:26.272259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:26.272531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:26.273332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] RBAC: Adding query filter params (name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:26.273893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:26.275477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:26.284666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 622/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:22:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:26.290610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:26.344242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:26.413637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04184f88-d8b1-4b26-8e3a-fafde3f6138f None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:26.449561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:26.450417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:26.450787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:26.451048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:26.463281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:26.464796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:26.485297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:26.486469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:26.487816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:26.487816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:26.487816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:26.487816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:26.487816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 602/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:26.492847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:26.623513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737ba88-624f-498c-859f-6223144b0070 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:26.661876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:26.662567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:26.662912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:26.663203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:26.663986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:26.664305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:26.665828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:26.680035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 623/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:26.686591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:26.789059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:26.796493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bf37-bb4a-433a-af60-ea388b09866b None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:26.835039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:26.836013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:26.836304 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:26.836584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:26.846071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:26.847842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:22:26.863318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:26.864623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:26.865819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 603/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:26.871154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:26.925590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:26.982831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca25f-4a35-48e2-8d9e-a9d7a1e049e6 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:27.020134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:27.020835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:27.021122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:27.021401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:27.022242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:27.022553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:27.024444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:27.046483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 624/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 19 16:22:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:27.052735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:27.161111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744ed82-5569-4c79-9c2a-a81ed40a66f2 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:27.200225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:27.201249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:27.201607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:27.201892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:27.216840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:27.218310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:27.238743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:27.239925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:27.245478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:27.245478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:27.245478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:27.245478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:27.245478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 604/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:27.245783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:27.358606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063d4d-7a15-45ac-aacf-38b4beb05c58 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:27.361230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:27.396208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:27.396877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:27.397159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:27.397436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:27.398160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:27.398755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:27.400143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:27.412290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 625/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:27.418772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:27.429893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:27.534063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae44d86-2945-4848-a2ea-12cb04ea743d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:27.577492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:27.578302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:27.578585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:27.578885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:27.586039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:27.587781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:22:27.603307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:27.605034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:27.606249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:27.610365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 605/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:22:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:27.611425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:27.740499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d975e-7102-4e4c-b7c6-9bdddce129d9 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:27.784288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:27.784954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:27.785234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:27.785506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:27.786294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:27.786602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:27.788085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecac5-7844-46b6-a27b-5366271dffde None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:27.803155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 626/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:22:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:27.809401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:27.880281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:27.919062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6e04d-2be9-4d7e-bcac-9443a7303bca None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:27.955662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9e11e-bd83-4b2d-b98e-37d3423583fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:27.956568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9e11e-bd83-4b2d-b98e-37d3423583fe None admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:27.956835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9e11e-bd83-4b2d-b98e-37d3423583fe None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:27.957164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9e11e-bd83-4b2d-b98e-37d3423583fe None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/0610a73cbaf54e21a63a0469ceb9c856/roles/c9b0a34b944b466bbfbebdc8c356ffdf` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:27.973346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9e11e-bd83-4b2d-b98e-37d3423583fe None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=0610a73cbaf54e21a63a0469ceb9c856, role_id=c9b0a34b944b466bbfbebdc8c356ffdf)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:27.974810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9e11e-bd83-4b2d-b98e-37d3423583fe None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:27.986906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 606/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:22:27 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/0610a73cbaf54e21a63a0469ceb9c856/roles/c9b0a34b944b466bbfbebdc8c356ffdf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:22:30.225247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b62d1-0e1a-4614-b997-99b4c672278e None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:30.225771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b62d1-0e1a-4614-b997-99b4c672278e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:30.225771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b62d1-0e1a-4614-b997-99b4c672278e None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:30.227097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 627/1233] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:30.233306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:30.233837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:30.233923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:30.253738 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:30.255165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:30.339502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 607/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 16:22:30.364867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b62d1-0e1a-4614-b997-99b4c672278e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:30.399110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:30.496638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b62d1-0e1a-4614-b997-99b4c672278e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:30.545023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:30.545838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:30.546162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:30.546552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:30.562232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:22:30.572305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:30.573466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:30.574321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 628/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Thu May 19 16:22:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:30.580626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:30.635442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:30.705500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f50bd-f3d3-466c-867f-bc0764afb622 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:30.750983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:30.751681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:30.752006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:30.752366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:30.753139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:30.753450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:30.755169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:30.766582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 608/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Thu May 19 16:22:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:22:30.774039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:30.875842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:30.898812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762ca45-591a-4d57-98ac-83b8041d1184 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:30.945006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:30.946053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:30.946348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:30.946659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:30.962437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:30.964456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:30.983934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:30.984973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:30.985885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:30.985885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:30.985885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:30.985885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:30.991650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 629/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:30.991800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:31.110666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a979e-ae06-4f58-8660-050ab75bcd87 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:31.121192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:31.151713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:31.152388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:31.152672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:31.152951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:31.153673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:31.153982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:31.155372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:31.167690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 609/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:31.173264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:31.290745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66ae6-2b10-4714-ba66-3d5494b7f799 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:31.327955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:31.328766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:31.329050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:31.329329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:31.332320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:31.337743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:31.340182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:22:31.357178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:31.358410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:31.359447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 630/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:31.366574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:31.496444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be4ea-f9b6-4684-98f6-2f87d8063024 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:31.559206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:31.560573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:31.561017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:31.561735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:31.563319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:31.563868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:31.565686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:31.591946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 610/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 19 16:22:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:31.599827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:31.734734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98324-9e6f-4b56-985c-47afa92ad102 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:31.774430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:31.775183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:31.775467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:31.775865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:31.843696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:31.850790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:31.852305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:31.978737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 631/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:22:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:22:31.985538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:32.015229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:32.108662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf9ced-a4b9-4fc6-a9ee-c52eee61095a None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:32.149227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:32.150052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:32.150334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:32.150626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:32.162932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:32.164488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:32.185632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:32.186646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:32.187574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:32.187574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:32.187574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:32.187574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:32.187574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 611/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:32.193113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:32.296620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:32.305119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b6023-4fce-452c-a8ef-a8f11e32a1ed None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:32.346046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:32.346961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:32.347398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:32.347834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:32.348933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:32.349486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:32.351487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:32.370752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 632/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:32.376866 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:32.473935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:32.499064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3a1c4-e720-4e87-b9f5-a1b9ced0ee1e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:32.544376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:32.545190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:32.545480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:32.545765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:32.553617 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:32.554988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:22:32.570388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:32.571507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:32.573590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 612/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:32.578122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:32.695763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee92f-6930-4e76-b31b-acb931254f6a None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:32.736179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:32.737003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:32.737322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:32.737790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:32.738888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:32.739228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:32.740892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcf708-6f26-421c-b43a-d32e99ead455 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:32.760859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 633/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:32.762415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:32.877834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e833-26e9-4e94-b902-c5c9c786df40 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:32.919074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:32.919699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:32.919987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:32.920270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:32.921105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] RBAC: Adding query filter params (role.id=c9b0a34b944b466bbfbebdc8c356ffdf, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=0610a73cbaf54e21a63a0469ceb9c856) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:32.921423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:32.922870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e275d2-1f0c-4235-a960-998db5f167f4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:32.929331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 613/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:22:32 2022] GET /identity/v3/role_assignments?user.id=0610a73cbaf54e21a63a0469ceb9c856&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=c9b0a34b944b466bbfbebdc8c356ffdf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:35.481960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316990a-89dc-4058-93f5-2ec43855df9a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:35.482531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316990a-89dc-4058-93f5-2ec43855df9a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:35.482531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316990a-89dc-4058-93f5-2ec43855df9a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:35.484191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 634/1247] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:35.491447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:35.491979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:35.492072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:35.499087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:35.514927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:35.516198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:35.608279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 614/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:35.636546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316990a-89dc-4058-93f5-2ec43855df9a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:35.660492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:35.754343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316990a-89dc-4058-93f5-2ec43855df9a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:35.793093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:35.793969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:35.794288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:35.794635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:35.806909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:22:35.820165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:35.821763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:35.822855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 635/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 16:22:35.828504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:35.947116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09362ac-0b82-4865-b784-13e19b4272ec None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:35.978664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:35.984893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:35.985650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:35.985941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:35.986259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:35.987130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:35.987448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:35.989065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:35.999392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 615/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:36.005115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:36.086372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:36.122038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8013-b9e2-47dc-b8b1-f6d3e71bd826 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:36.163746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:36.164798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:36.165071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:36.165371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:36.178819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:36.180409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:36.201176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:36.202174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:36.203236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:36.203236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:36.203236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:36.203236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:36.203236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 636/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:36.208659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:36.328095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3b593-b0ab-4fa4-915d-54c38232a05d None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:36.365487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:36.366155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:36.366440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:36.366717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:36.367440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:36.367788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:36.369159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:36.381544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 616/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:36.388453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:36.497182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7888-874c-4b94-b51e-4b9d74d26d03 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:36.533771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:36.543857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:36.544656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:36.544979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:36.545254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:36.554099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:36.555510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:22:36.573498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:36.574710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:36.575724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 637/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:36.580944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:36.649428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:36.694947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d52c9-5945-42b2-b0a4-6f2c7d358fa4 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:36.732803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:36.733473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:36.733754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:36.734027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:36.734903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:36.735191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:36.736682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:36.754282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 617/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 19 16:22:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:36.760178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:36.873266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cfe84-56da-4be8-b0cc-7fdafedf9fdd None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:36.910403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:36.911200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:36.911500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:36.911861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:36.977025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:36.992147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:36.993614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:37.108015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 638/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:22:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:22:37.114209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:37.221491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3bac-2425-4330-a45d-e8c2b364a1f1 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:37.236697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:37.259558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:37.260442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:37.260722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:37.260994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:37.271775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:37.273518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:37.292321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:37.293420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:37.294427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:37.294427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:37.294427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:37.294427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:37.294427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 618/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:37.299547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:37.391921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:37.404874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7f71e-73f5-4622-b9d7-ff9d7666ae53 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:37.442484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:37.443164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:37.443442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:37.443742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:37.444477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:37.444783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:37.446198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:37.458970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 639/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:37.465461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:37.583936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba9ce-89f9-4759-90f5-d563e6cce232 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:37.620445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:37.621252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:37.621538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:37.621817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:37.628644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:37.630098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:22:37.643754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:37.644766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:37.645826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 619/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:37.651595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:37.754342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1c5d-d6b5-49f1-a648-9c4be441b916 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:37.789950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:37.790610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:37.790891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:37.791173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:37.792007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:37.792317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:37.793772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bef187-1aaa-4f79-bc77-54c6ac19fe36 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:37.806537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 640/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:22:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:37.812432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:37.845377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:37.921930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27d38-8e69-46e3-bca1-e3644d7ae3cb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:37.954784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:37.955448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:37.955767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:37.956049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:37.956878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=0610a73cbaf54e21a63a0469ceb9c856) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:37.957196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:37.958631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34bb80-467e-4e5c-b46f-4c82717d2686 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:37.964641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 620/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:22:37 2022] GET /identity/v3/role_assignments?user.id=0610a73cbaf54e21a63a0469ceb9c856&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=627731b88fe44de39e8e182a119e4c00 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:40.180246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244c4f3-f85e-4c58-9549-d92e14c90f66 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:40.180774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244c4f3-f85e-4c58-9549-d92e14c90f66 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:40.180774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244c4f3-f85e-4c58-9549-d92e14c90f66 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:40.182095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 641/1261] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:40.187317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:40.187783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:40.187909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:40.204642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:40.205801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:40.269016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 621/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:40.291994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244c4f3-f85e-4c58-9549-d92e14c90f66 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:40.302735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:40.392468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244c4f3-f85e-4c58-9549-d92e14c90f66 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:40.425391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:40.426178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:40.426461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:40.426736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:40.437361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:22:40.444941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:40.446042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:40.446945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 642/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:40.452731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:40.470373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:40.554927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1d0b-1b4d-469b-8179-e04383cf6b0a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:40.590710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:40.591374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:40.591882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:40.591994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:40.592704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:40.593016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:40.594392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:40.602329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 622/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:22:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:40.608254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:40.672915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:40.706423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a808-f39b-4594-9428-53f6e8f1aea0 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:40.738539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:40.739316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:40.739597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:40.739901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:40.751387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:40.752886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:40.769413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:40.770455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:40.771788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:40.771788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:40.771788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:40.771788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:40.771788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 643/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:40.776575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:40.860229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:40.880621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce2bb-dca0-44d2-acba-7f1c4a3b8a1e None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:40.913735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:40.914402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:40.914686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:40.914962 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:40.915713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:40.916025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:40.917920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:40.929639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 623/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:40.935819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:41.032186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52d5c5-36c9-485c-a94a-1afb4bc0b462 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:41.051276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:41.065701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:41.066491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:41.066771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:41.067048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:41.074379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:41.075866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:22:41.089787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:41.090918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:41.092144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 644/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:41.096771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:41.193274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593cacb-feb2-465a-960b-853381895e65 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:41.227158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:41.227848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:41.228132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:41.228408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:41.229795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:41.230106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:41.231534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:41.240067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:41.248580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 624/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 19 16:22:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:41.254177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:41.350280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79eddc-4a63-4b7c-989a-c229abc2663b None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:41.383433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:41.384255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:41.384538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:41.384815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:41.395433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:41.396942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:41.414440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:41.415514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:41.417253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:41.417253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:41.417253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:41.417253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:41.417253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 645/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:41.421865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:41.523850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff171f-6af9-4c62-8bf3-50c66c1b14ec None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:41.563073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:41.563763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:41.564050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:41.564328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:41.565046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:41.565353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:41.566724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:41.578373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 625/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:41.584004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:41.619010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:41.687578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06bc4-2d1e-4068-9b81-322fc5c08cec None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:41.721350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:41.722144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:41.722425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:41.722699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:41.729336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:41.730812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:22:41.744698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:41.745727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:41.746867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 646/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:41.753357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:41.811599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:41.853713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa01d6-6246-4f2e-9b10-3b657eb90b93 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:41.892502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:41.893088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:41.893375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:41.893656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:41.894457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:41.894770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:41.896257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654115-479e-43ab-b082-1e54f1e253d2 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:41.909185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 626/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:41.915111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:42.004018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:42.013414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a717d-3676-46d2-8a2f-b22288a0838f None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:42.046539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317cc23-52ce-4116-bf36-70004091d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:42.047422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317cc23-52ce-4116-bf36-70004091d5bc None admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:42.047730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317cc23-52ce-4116-bf36-70004091d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:42.048010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317cc23-52ce-4116-bf36-70004091d5bc None admin] PATH_INFO: `/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/0610a73cbaf54e21a63a0469ceb9c856/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:42.049930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317cc23-52ce-4116-bf36-70004091d5bc None admin] RBAC: Authorizing `identity:create_grant(project_id=b491dffa24c243239d6f40dbacbe6cc5, user_id=0610a73cbaf54e21a63a0469ceb9c856, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:42.051377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317cc23-52ce-4116-bf36-70004091d5bc None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:42.065558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 647/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Thu May 19 16:22:41 2022] PUT /identity/v3/projects/b491dffa24c243239d6f40dbacbe6cc5/users/0610a73cbaf54e21a63a0469ceb9c856/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:22:44.245496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da381-43d5-43bf-a860-9e75bf24e545 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:44.245997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da381-43d5-43bf-a860-9e75bf24e545 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:44.245997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da381-43d5-43bf-a860-9e75bf24e545 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:44.247347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 627/1274] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:44.252487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:44.252948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:44.253043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:44.270118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:44.271296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:44.336874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 648/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:44.361112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da381-43d5-43bf-a860-9e75bf24e545 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:44.460967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da381-43d5-43bf-a860-9e75bf24e545 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:44.479082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:44.497337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:44.498045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:44.498322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:44.498593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:44.511153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 16:22:44.518976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:44.520245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:44.521298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 628/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Thu May 19 16:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:44.527874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:44.610780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:44.629018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a82e54-7783-49b2-b583-825cdf4f1467 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:44.662713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:44.663376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:44.663679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:44.663956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:44.664705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:44.665010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:44.666390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:44.674321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 649/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu May 19 16:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:44.680010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:44.785129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c3571-5987-48a8-8a39-f54710533ab8 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:44.817068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:44.817847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:44.818131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:44.818405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:44.829201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:44.830650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:44.847836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:44.848884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:44.850116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:44.850116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:44.850116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:44.850116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:44.850116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 629/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:44.854753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:44.958313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0437-e277-425d-8304-97286e5d7373 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:45.000927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:45.001807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:45.002172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:45.002535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:45.003433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:45.003904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:45.005643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:45.021170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 650/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:45.027052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:45.059162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:45.127236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871094b6-ea9d-4254-a0f5-3a24dca001d6 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:45.160275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:45.161074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:45.161361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:45.161640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:45.169858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:45.171312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 16:22:45.185772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:45.186710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:45.187712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 630/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:45.192804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:45.196548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:45.291632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54296513-22a5-40f2-9d49-158c6ea35435 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:45.325341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:45.325934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:45.326219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:45.326497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:45.327346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:45.327684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:45.329151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:45.346256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 651/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Thu May 19 16:22:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:22:45.351992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:45.444460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:45.454206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d07d92-5938-46b3-b7de-0b0eb044ed59 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:45.486990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:45.487673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:45.487963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:45.488243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:45.559642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:45.561109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:45.646887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:45.657531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 631/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Thu May 19 16:22:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 16:22:45.663306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:45.722976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:45.761732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ecee-2098-4d4e-aae3-1c7d18f4da0c None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:45.794488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:45.795269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:45.795554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:45.795858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:45.805481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:45.807472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 16:22:45.825747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:45.826698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:45.827635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 16:22:45.827635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 16:22:45.827635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 16:22:45.827635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:45.827635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 652/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:45.832710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:45.929718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0c0bc-dfed-4e79-b8e1-6703598fc8fb None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:45.963302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:45.963988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:45.964274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:45.964557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:45.965274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:45.965584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:45.966957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:45.977853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 632/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Thu May 19 16:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:22:45.983950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:46.080644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fee8b1-efde-467a-8891-ed2531190091 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:46.094029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:46.114324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:46.115099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:46.115380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:46.115673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:46.122722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:46.124214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 16:22:46.137648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application with Lock( May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:46.138689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: ERROR keystone.server.flask.application May 19 16:22:46.139851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 653/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Thu May 19 16:22:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:46.144801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:46.194482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:46.243780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4f00-5c59-455a-97e1-bde446dc62ec None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:46.276676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:46.277323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:46.277608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:46.277883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:46.278660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:46.278970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:46.280435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487cfb0-425a-4f75-abf8-0188db55279e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:46.292525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 633/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Thu May 19 16:22:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:46.298582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:46.398289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d41e-c974-4794-a3e5-2406fadc0340 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:46.434815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:46.435454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:46.435762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:46.436035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:46.436857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] RBAC: Adding query filter params (role.id=627731b88fe44de39e8e182a119e4c00, scope.project.id=b491dffa24c243239d6f40dbacbe6cc5, user.id=0610a73cbaf54e21a63a0469ceb9c856) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:46.437162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:46.438600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318da2ee-6c0d-4a85-87f1-9d3fc9ea48ed None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:46.444295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 654/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Thu May 19 16:22:46 2022] GET /identity/v3/role_assignments?user.id=0610a73cbaf54e21a63a0469ceb9c856&scope.project.id=b491dffa24c243239d6f40dbacbe6cc5&role.id=627731b88fe44de39e8e182a119e4c00 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:48.672657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a1ef-7062-4ce4-9701-f40792b2d94b None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:48.673194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a1ef-7062-4ce4-9701-f40792b2d94b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:48.673194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a1ef-7062-4ce4-9701-f40792b2d94b None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:48.674554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 634/1288] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:48.679665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:48.680061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:48.680239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:48.697832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:48.699012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:48.727765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:48.766151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 655/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:48.788618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a1ef-7062-4ce4-9701-f40792b2d94b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:48.886235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a1ef-7062-4ce4-9701-f40792b2d94b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:48.897761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:48.921287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:48.922152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:48.922436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:48.922787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:48.923396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:48.924798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:48.937061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:48.938290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:48.939206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 635/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:22:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:48.944332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:49.042008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a1dda-42f4-41c7-96a2-44f83843666d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:49.075045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:49.075728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:49.076016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:49.076294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:49.076996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:49.077304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:49.078761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8f3d-453d-4d66-99c9-81d3e4f0dcc3 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:49.083549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 656/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 19 16:22:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:49.089803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:49.185037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8ff7c-1b16-47a0-926c-65d32b51ae72 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:49.217795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:49.218442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:49.218725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:49.219001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] PATH_INFO: `/v3/services` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:49.219720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:49.220029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:49.221414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b10ba-8065-4b3d-9fdd-2bf0b40c6d9e None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:49.225708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 636/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 19 16:22:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:51.468408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faf137-33b1-4469-89fd-b82ba5b96cd1 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:51.468936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faf137-33b1-4469-89fd-b82ba5b96cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:51.469028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faf137-33b1-4469-89fd-b82ba5b96cd1 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:51.470353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 657/1293] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:51.475968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7a3e-b314-42a6-9141-470677faf1f7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:51.476434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7a3e-b314-42a6-9141-470677faf1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:51.476523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7a3e-b314-42a6-9141-470677faf1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:51.493807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-522a7a3e-b314-42a6-9141-470677faf1f7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:51.495222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-522a7a3e-b314-42a6-9141-470677faf1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:51.529171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:51.575804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 637/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:51.592370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faf137-33b1-4469-89fd-b82ba5b96cd1 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:51.630341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:51.703886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faf137-33b1-4469-89fd-b82ba5b96cd1 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:51.739816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9d1e1-ccae-4aa2-b785-5eeed3a16ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:51.740410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d1e1-ccae-4aa2-b785-5eeed3a16ac2 None admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:51.740693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d1e1-ccae-4aa2-b785-5eeed3a16ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:51.740967 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d1e1-ccae-4aa2-b785-5eeed3a16ac2 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:51.741677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9d1e1-ccae-4aa2-b785-5eeed3a16ac2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:51.743058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9d1e1-ccae-4aa2-b785-5eeed3a16ac2 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:51.756324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 658/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Thu May 19 16:22:51 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:22:54.019360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816303d3-d783-4373-8a2c-09eb075d005e None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:54.019913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816303d3-d783-4373-8a2c-09eb075d005e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:54.020035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816303d3-d783-4373-8a2c-09eb075d005e None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:54.021317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 638/1296] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:54.026918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:54.027317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:54.027483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:54.043923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:54.045096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:54.116579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 659/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:54.140375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816303d3-d783-4373-8a2c-09eb075d005e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:54.238897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816303d3-d783-4373-8a2c-09eb075d005e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:54.273230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:54.274024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:54.274303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:54.274578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:54.275255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:54.276660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:54.288274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:54.289460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:54.291087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 639/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:22:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:54.296525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:54.314831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:54.393267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35950cf-1e03-4138-8465-e5dc22ffc279 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:54.426759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:54.427420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:54.427733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:54.428012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:54.428716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:54.429028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:54.430413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:54.436191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 660/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 19 16:22:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:54.442282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:54.474589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:54.543470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a632-3bee-4197-9db2-bb1d4c0d8bd4 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:54.575845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:54.576498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:54.576786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:54.577070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:54.577860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] RBAC: Adding query filter params (interface=public, service_id=664d9059448c4b69acc8d344e0f74d63, region_id=RegionOne) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:54.578178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:54.579548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ffad8-4be4-4b93-a109-143bb64aa425 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:54.584511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 640/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Thu May 19 16:22:54 2022] GET /identity/v3/endpoints?service_id=664d9059448c4b69acc8d344e0f74d63&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:54.590130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:54.670953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:54.688827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c13e-7599-4506-a8ac-4c7baa7c1018 None admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:54.721745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bca15-08c7-4d7e-97ec-f30889016b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:54.722403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bca15-08c7-4d7e-97ec-f30889016b60 None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:54.722681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bca15-08c7-4d7e-97ec-f30889016b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:54.722951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bca15-08c7-4d7e-97ec-f30889016b60 None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:54.723650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bca15-08c7-4d7e-97ec-f30889016b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:54.725032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bca15-08c7-4d7e-97ec-f30889016b60 None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:54.732295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 661/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Thu May 19 16:22:54 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:22:56.920126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf097-0b0e-4b2c-8f25-bffca940849d None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:56.920627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf097-0b0e-4b2c-8f25-bffca940849d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:56.920727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf097-0b0e-4b2c-8f25-bffca940849d None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:56.922056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 641/1302] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:22:56.927319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:56.927777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:56.927909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:56.944575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:22:56.945742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:22:57.010208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 662/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:22:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 16:22:57.033648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf097-0b0e-4b2c-8f25-bffca940849d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:57.128244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:57.135159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf097-0b0e-4b2c-8f25-bffca940849d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:57.168394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:57.169185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:57.169471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:57.169751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:57.170408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:57.171810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 16:22:57.184250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 16:22:57.185501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.get_or_create( May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application with Lock( May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self._enter() May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application return self.creator() May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application created_value = creator( May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: ERROR keystone.server.flask.application May 19 16:22:57.186442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 642/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Thu May 19 16:22:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 16:22:57.191567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:57.266519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:22:57.289828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c48f-8c7b-460f-9f77-f4b7c3328fce None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:57.324239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:57.324901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:57.325187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:57.325466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] PATH_INFO: `/v3/services` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:57.326171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:22:57.326479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:57.327889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d199d-5467-4f18-a687-af6111a4f97f None admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:57.332979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 663/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Thu May 19 16:22:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:22:57.338708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:22:57.438490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3219a9-3096-4eaf-b804-c6f185c04f20 None admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:22:57.470686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2db154-eb71-4b8b-ba11-dc8069d49e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:22:57.471338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db154-eb71-4b8b-ba11-dc8069d49e02 None admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:22:57.471650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db154-eb71-4b8b-ba11-dc8069d49e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:22:57.471937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db154-eb71-4b8b-ba11-dc8069d49e02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:22:57.472682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2db154-eb71-4b8b-ba11-dc8069d49e02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:22:57.474061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2db154-eb71-4b8b-ba11-dc8069d49e02 None admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:22:57.492211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 643/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Thu May 19 16:22:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:23:07.330084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=30 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:23:07.487933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:02.055594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4ee3-e100-42c8-9b14-f53a62847a0c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:02.056233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4ee3-e100-42c8-9b14-f53a62847a0c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:02.056233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4ee3-e100-42c8-9b14-f53a62847a0c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:02.063010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d07a3-af84-4af6-8133-e5290027c778 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:02.063500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d07a3-af84-4af6-8133-e5290027c778 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:02.063585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d07a3-af84-4af6-8133-e5290027c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:02.067046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 664/1307] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:02.148500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bf2d07a3-af84-4af6-8133-e5290027c778 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:02.149702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bf2d07a3-af84-4af6-8133-e5290027c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:02.304701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 644/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:24:02.345512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67a12-8701-4f9b-ac26-2d2fc1b0d3d3 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:02.346077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67a12-8701-4f9b-ac26-2d2fc1b0d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:02.346527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67a12-8701-4f9b-ac26-2d2fc1b0d3d3 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:02.348574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 665/1309] 10.222.0.25 () {54 vars in 964 bytes} [Thu May 19 16:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:02.355253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ed20c-d623-4592-b53a-ef5e07ad87a9 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:02.355600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ed20c-d623-4592-b53a-ef5e07ad87a9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:02.355858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ed20c-d623-4592-b53a-ef5e07ad87a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:02.458433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e23ed20c-d623-4592-b53a-ef5e07ad87a9 None None] MFA Rules not processed for user `6ae2e3c1b1b04ce7950a81c33308d560`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:02.461939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e23ed20c-d623-4592-b53a-ef5e07ad87a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:02.486072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:02.562719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b67a12-8701-4f9b-ac26-2d2fc1b0d3d3 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:02.565373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-67b67a12-8701-4f9b-ac26-2d2fc1b0d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:02.570482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 645/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Thu May 19 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:02.708293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b67a12-8701-4f9b-ac26-2d2fc1b0d3d3 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:02.797840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:02.798819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:02.799340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:02.799833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:02.801686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:02.863757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:02.933100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:02.934493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef189-8b8c-4055-9d15-2699d5f9753b service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:02.954432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 666/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:24:05.471944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06cc0-e1ab-4639-bdb9-173915d50bce None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:05.472441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06cc0-e1ab-4639-bdb9-173915d50bce None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:05.472441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06cc0-e1ab-4639-bdb9-173915d50bce None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:05.473907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 646/1312] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:05.479913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f1d33-fa0b-435d-bfeb-5deac5c6d73f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:05.480373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f1d33-fa0b-435d-bfeb-5deac5c6d73f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:05.480583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f1d33-fa0b-435d-bfeb-5deac5c6d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:05.551330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-612f1d33-fa0b-435d-bfeb-5deac5c6d73f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:05.552560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-612f1d33-fa0b-435d-bfeb-5deac5c6d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:05.650838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 667/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:05.687283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06cc0-e1ab-4639-bdb9-173915d50bce None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:05.688975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-90b06cc0-e1ab-4639-bdb9-173915d50bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:05.792177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06cc0-e1ab-4639-bdb9-173915d50bce None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:05.861549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:05.864573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:05.865411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:05.865871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:05.866893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:05.868812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:05.980844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:05.982283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212a1c-4c2d-4f6a-bc2b-4722462fdf6a service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:06.000261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 647/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:08.598588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3246-a6a5-48a6-9e97-68b3006e38a0 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:08.599169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3246-a6a5-48a6-9e97-68b3006e38a0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:08.599169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3246-a6a5-48a6-9e97-68b3006e38a0 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:08.600616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 668/1315] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:08.606490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f3cf-849a-401b-bd6d-26152043af10 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:08.607041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f3cf-849a-401b-bd6d-26152043af10 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:08.607248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f3cf-849a-401b-bd6d-26152043af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:08.678695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b220f3cf-849a-401b-bd6d-26152043af10 None None] MFA Rules not processed for user `3a4b9074f6ee42cea226d3c5b226e887`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:08.679978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b220f3cf-849a-401b-bd6d-26152043af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:08.734255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:08.781217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 648/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:08.837687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256b56-0f55-4979-a6a5-98a3360ba0d7 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:08.837973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256b56-0f55-4979-a6a5-98a3360ba0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:08.838254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256b56-0f55-4979-a6a5-98a3360ba0d7 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:08.839661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 669/1317] 10.222.0.25 () {54 vars in 964 bytes} [Thu May 19 16:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:08.845966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fd71e-d2b8-45b7-876c-17221b7d2936 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:08.846259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fd71e-d2b8-45b7-876c-17221b7d2936 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:08.846537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fd71e-d2b8-45b7-876c-17221b7d2936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:08.930806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e08fd71e-d2b8-45b7-876c-17221b7d2936 None None] MFA Rules not processed for user `6ae2e3c1b1b04ce7950a81c33308d560`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:08.932063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e08fd71e-d2b8-45b7-876c-17221b7d2936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:09.015581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 649/1318] 10.222.0.25 () {58 vars in 1061 bytes} [Thu May 19 16:24:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:09.024880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256b56-0f55-4979-a6a5-98a3360ba0d7 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:09.026716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2b256b56-0f55-4979-a6a5-98a3360ba0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:09.037267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:09.137552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256b56-0f55-4979-a6a5-98a3360ba0d7 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:09.211873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:09.212447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:09.212734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:09.213009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:09.214664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:09.279989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:09.332854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:09.334329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf83f7-a56c-4ab4-8b3b-628f47174dc7 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:09.353735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 670/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:24:12.503351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7e24f-0ee1-4988-9385-692ef2965796 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:12.503926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7e24f-0ee1-4988-9385-692ef2965796 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:12.503926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7e24f-0ee1-4988-9385-692ef2965796 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:12.505325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 650/1320] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:12.510946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6afad-4adf-4290-8b10-27bf8e6b5146 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:12.511383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6afad-4adf-4290-8b10-27bf8e6b5146 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:12.511730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6afad-4adf-4290-8b10-27bf8e6b5146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:12.579170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-29d6afad-4adf-4290-8b10-27bf8e6b5146 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:12.580407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-29d6afad-4adf-4290-8b10-27bf8e6b5146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:12.677248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 671/1321] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:12.715363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7e24f-0ee1-4988-9385-692ef2965796 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:12.716943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-65c7e24f-0ee1-4988-9385-692ef2965796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:12.766100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:12.819117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7e24f-0ee1-4988-9385-692ef2965796 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:12.890626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:12.891272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:12.891551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:12.891850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:12.893491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:12.987150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:13.000368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:13.001798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b9d63-b40f-48cb-913a-0aa62809a378 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:13.020067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 651/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:15.901062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f9cac-299c-46ec-9cee-c9dfd5d88940 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:15.901515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f9cac-299c-46ec-9cee-c9dfd5d88940 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:15.901639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f9cac-299c-46ec-9cee-c9dfd5d88940 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:15.903050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 672/1323] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:15.908623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22eb3-bee3-4a6d-a02d-ab1014401fc1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:15.909116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22eb3-bee3-4a6d-a02d-ab1014401fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:15.909212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22eb3-bee3-4a6d-a02d-ab1014401fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:15.974896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-3ef22eb3-bee3-4a6d-a02d-ab1014401fc1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:15.976714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3ef22eb3-bee3-4a6d-a02d-ab1014401fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:16.075387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 652/1324] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:16.114366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f9cac-299c-46ec-9cee-c9dfd5d88940 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:16.115958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-420f9cac-299c-46ec-9cee-c9dfd5d88940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:16.135558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:16.220631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f9cac-299c-46ec-9cee-c9dfd5d88940 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:16.294444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:16.295096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:16.295408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:16.295726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:16.297418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:16.373268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:16.417459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:16.418918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098497-59ce-4ab3-94e8-9739216151a9 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:16.438180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 673/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:18.818515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390661ec-7d3c-407b-be21-3387f4d5c7b0 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:18.819115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390661ec-7d3c-407b-be21-3387f4d5c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:18.819220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390661ec-7d3c-407b-be21-3387f4d5c7b0 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:18.821069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 653/1326] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:18.826444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590803-ac7a-49e3-b3f1-76ff329b4606 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:18.826909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590803-ac7a-49e3-b3f1-76ff329b4606 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:18.827000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590803-ac7a-49e3-b3f1-76ff329b4606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:18.896778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-36590803-ac7a-49e3-b3f1-76ff329b4606 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:18.898040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-36590803-ac7a-49e3-b3f1-76ff329b4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:19.002056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 674/1327] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:19.037747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390661ec-7d3c-407b-be21-3387f4d5c7b0 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:19.039880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-390661ec-7d3c-407b-be21-3387f4d5c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:19.099722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:19.142780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390661ec-7d3c-407b-be21-3387f4d5c7b0 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:19.215057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:19.215731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:19.216032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:19.216284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:19.217908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:19.326244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:19.328855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:19.330937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f02b-9526-442a-bfcd-9acbaa29c7d1 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:19.350806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 654/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:21.631820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ae00-2fdd-4301-9f04-b3fbffef490d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:21.632385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ae00-2fdd-4301-9f04-b3fbffef490d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:21.632385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ae00-2fdd-4301-9f04-b3fbffef490d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:21.633760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 675/1329] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:21.639005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38bf2f-82d9-47c9-ae44-341959d6bfca None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:21.639452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38bf2f-82d9-47c9-ae44-341959d6bfca None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:21.639578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38bf2f-82d9-47c9-ae44-341959d6bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:21.705940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2a38bf2f-82d9-47c9-ae44-341959d6bfca None None] MFA Rules not processed for user `3a4b9074f6ee42cea226d3c5b226e887`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:21.707148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2a38bf2f-82d9-47c9-ae44-341959d6bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:21.803848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 655/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:21.841317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ae00-2fdd-4301-9f04-b3fbffef490d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:21.842953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7b76ae00-2fdd-4301-9f04-b3fbffef490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:21.876263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:21.954738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ae00-2fdd-4301-9f04-b3fbffef490d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:22.029727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:22.030377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:22.030652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:22.030918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:22.032574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:22.109203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:22.141380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:22.142867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3e84-828e-4b09-b593-e9c3369c9590 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:22.161329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 676/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:24.618832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778db1-95c9-49e1-9425-99f9c0814ee6 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:24.619392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778db1-95c9-49e1-9425-99f9c0814ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:24.619392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778db1-95c9-49e1-9425-99f9c0814ee6 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:24.620800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 656/1332] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:24.626339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4a8b-910a-431d-8263-40906422e37f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:24.626772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4a8b-910a-431d-8263-40906422e37f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:24.627022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a4a8b-910a-431d-8263-40906422e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:24.697552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f23a4a8b-910a-431d-8263-40906422e37f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:24.698763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f23a4a8b-910a-431d-8263-40906422e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:24.803439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 677/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:24.838806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16778db1-95c9-49e1-9425-99f9c0814ee6 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:24.840546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-16778db1-95c9-49e1-9425-99f9c0814ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:24.919281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:24.955034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16778db1-95c9-49e1-9425-99f9c0814ee6 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:25.029354 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:25.029935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:25.030217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:25.030494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:25.032173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:25.140156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:25.141615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef90a-b914-4e72-bcf0-5f4c9295448b service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:25.153533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:25.163083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 657/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:27.461049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e04a2-ec40-4caf-a453-177a4c0fc801 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:27.461917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e04a2-ec40-4caf-a453-177a4c0fc801 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:27.461917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e04a2-ec40-4caf-a453-177a4c0fc801 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:27.462960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 678/1335] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:27.468837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d504e-5eb2-4b6f-bf76-1659ac68a605 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:27.469310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d504e-5eb2-4b6f-bf76-1659ac68a605 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:27.469595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d504e-5eb2-4b6f-bf76-1659ac68a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:27.535290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-382d504e-5eb2-4b6f-bf76-1659ac68a605 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:27.536532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-382d504e-5eb2-4b6f-bf76-1659ac68a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:27.634234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 658/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:27.673943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e04a2-ec40-4caf-a453-177a4c0fc801 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:27.675479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-273e04a2-ec40-4caf-a453-177a4c0fc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:27.715900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:27.778878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e04a2-ec40-4caf-a453-177a4c0fc801 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:27.854227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:27.854895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:27.855181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:27.855459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:27.857213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:27.948052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:27.978131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:27.979636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303073ed-cb11-4e83-aed3-30ca04ab023e service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:27.999857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 679/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:30.631280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f21bd-b7fa-4427-93e4-c7bd6ed3e55e None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:30.631912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f21bd-b7fa-4427-93e4-c7bd6ed3e55e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:30.632031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f21bd-b7fa-4427-93e4-c7bd6ed3e55e None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:30.633343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 659/1338] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:30.638508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eea7cb-9a55-4b6b-a588-64bc09fdb1e6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:30.638977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eea7cb-9a55-4b6b-a588-64bc09fdb1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:30.639075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eea7cb-9a55-4b6b-a588-64bc09fdb1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:30.705860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-07eea7cb-9a55-4b6b-a588-64bc09fdb1e6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:30.707087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-07eea7cb-9a55-4b6b-a588-64bc09fdb1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:30.809564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 680/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:30.848048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f21bd-b7fa-4427-93e4-c7bd6ed3e55e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:30.849619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a77f21bd-b7fa-4427-93e4-c7bd6ed3e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:30.932008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:30.961341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f21bd-b7fa-4427-93e4-c7bd6ed3e55e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:31.043745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:31.044405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:31.044691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:31.044974 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:31.046651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:31.159522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:31.160933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b833e-1607-4282-acba-ae276e897a75 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:31.179092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 660/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:35.418158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed6ef-d1dc-4d52-a032-88fe5bd5cf46 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:35.418727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed6ef-d1dc-4d52-a032-88fe5bd5cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:35.418727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed6ef-d1dc-4d52-a032-88fe5bd5cf46 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:35.420204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 681/1341] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:35.425854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79221e3a-2f0e-4a34-b505-1c159bcfb67b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:35.426322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79221e3a-2f0e-4a34-b505-1c159bcfb67b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:35.426452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79221e3a-2f0e-4a34-b505-1c159bcfb67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:35.432841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:35.510476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-79221e3a-2f0e-4a34-b505-1c159bcfb67b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:35.511651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-79221e3a-2f0e-4a34-b505-1c159bcfb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:35.627922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 661/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:35.666357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ed6ef-d1dc-4d52-a032-88fe5bd5cf46 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:35.668736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f61ed6ef-d1dc-4d52-a032-88fe5bd5cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:35.722072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:35.774941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ed6ef-d1dc-4d52-a032-88fe5bd5cf46 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:35.778654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc8df4-e3d3-4532-84ea-c2c38c4e413f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:35.779336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8df4-e3d3-4532-84ea-c2c38c4e413f service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:35.779688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8df4-e3d3-4532-84ea-c2c38c4e413f service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:35.779936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8df4-e3d3-4532-84ea-c2c38c4e413f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:35.790441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc8df4-e3d3-4532-84ea-c2c38c4e413f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:35.791993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc8df4-e3d3-4532-84ea-c2c38c4e413f service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:35.803162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 682/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:38.711310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399a44-c3a7-4a0e-a266-b89a800ca1c3 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:38.711877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399a44-c3a7-4a0e-a266-b89a800ca1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:38.711877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399a44-c3a7-4a0e-a266-b89a800ca1c3 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:38.713243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 662/1344] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:38.718599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5759-60a9-45f5-9b3f-0c9eba83c05d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:38.718998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5759-60a9-45f5-9b3f-0c9eba83c05d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:38.719168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5759-60a9-45f5-9b3f-0c9eba83c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:38.747860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e98e5759-60a9-45f5-9b3f-0c9eba83c05d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:38.749065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e98e5759-60a9-45f5-9b3f-0c9eba83c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:38.830446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 683/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:38.869549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08399a44-c3a7-4a0e-a266-b89a800ca1c3 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:38.880671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08399a44-c3a7-4a0e-a266-b89a800ca1c3 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:38.885298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb833d39-a3ea-4e2c-95ea-e2ae3d6b0f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:38.886429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833d39-a3ea-4e2c-95ea-e2ae3d6b0f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:38.886786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833d39-a3ea-4e2c-95ea-e2ae3d6b0f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:38.887131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833d39-a3ea-4e2c-95ea-e2ae3d6b0f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:38.899632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb833d39-a3ea-4e2c-95ea-e2ae3d6b0f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:38.901094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb833d39-a3ea-4e2c-95ea-e2ae3d6b0f7d service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:38.910592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 663/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:43.180167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37b7b-2bbd-4575-8e41-8a766be3cb7a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:43.180715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37b7b-2bbd-4575-8e41-8a766be3cb7a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:43.180715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37b7b-2bbd-4575-8e41-8a766be3cb7a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:43.182130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 684/1347] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:43.187415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab335a-8736-44ce-8656-fc81d9c0bec2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:43.187944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab335a-8736-44ce-8656-fc81d9c0bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:43.188039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab335a-8736-44ce-8656-fc81d9c0bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:43.206724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c8ab335a-8736-44ce-8656-fc81d9c0bec2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:43.207988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c8ab335a-8736-44ce-8656-fc81d9c0bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:43.216627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 664/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:43.253092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37b7b-2bbd-4575-8e41-8a766be3cb7a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:43.266323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37b7b-2bbd-4575-8e41-8a766be3cb7a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:43.269855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145524bc-818f-41aa-a4dd-13698d8fe356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:43.270501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145524bc-818f-41aa-a4dd-13698d8fe356 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:43.270794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145524bc-818f-41aa-a4dd-13698d8fe356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:43.271072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145524bc-818f-41aa-a4dd-13698d8fe356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:43.281754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145524bc-818f-41aa-a4dd-13698d8fe356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:43.283248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145524bc-818f-41aa-a4dd-13698d8fe356 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:43.293732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 685/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:24:48.843379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58feb47-6f11-4090-9578-66fec896a593 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:48.843930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58feb47-6f11-4090-9578-66fec896a593 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:48.844150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58feb47-6f11-4090-9578-66fec896a593 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:48.846069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 665/1350] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:48.852324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aac530-7049-4a98-8b8f-cb698a302714 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:48.853186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aac530-7049-4a98-8b8f-cb698a302714 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:48.853672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aac530-7049-4a98-8b8f-cb698a302714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:48.944656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f4aac530-7049-4a98-8b8f-cb698a302714 None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:48.946221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f4aac530-7049-4a98-8b8f-cb698a302714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:48.976837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:49.038902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 686/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:53.201180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=72 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:24:53.437009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143499ae-c221-4dff-ac95-78f1f4b956b3 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:53.437324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143499ae-c221-4dff-ac95-78f1f4b956b3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:53.437588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143499ae-c221-4dff-ac95-78f1f4b956b3 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:53.439334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 666/1352] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:53.444743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e88a7-2e51-4141-b373-ef0464134c35 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:53.445280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e88a7-2e51-4141-b373-ef0464134c35 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:53.445280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e88a7-2e51-4141-b373-ef0464134c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:53.466210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4c9e88a7-2e51-4141-b373-ef0464134c35 None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:53.467314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4c9e88a7-2e51-4141-b373-ef0464134c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:53.477137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 687/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:24:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:24:55.344413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519f33-380a-449c-8767-f55f8885088a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:55.344943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519f33-380a-449c-8767-f55f8885088a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:55.345041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519f33-380a-449c-8767-f55f8885088a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:55.346397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 667/1354] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:55.352198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0fe3a-dde5-49b0-8c15-07224b18aded None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:55.352630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0fe3a-dde5-49b0-8c15-07224b18aded None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:55.352744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0fe3a-dde5-49b0-8c15-07224b18aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:55.371659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-88e0fe3a-dde5-49b0-8c15-07224b18aded None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:55.372862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-88e0fe3a-dde5-49b0-8c15-07224b18aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:55.381288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 688/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:24:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:59.057135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314c35-dbe9-45c6-9d38-d1623bd9b718 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:59.057714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314c35-dbe9-45c6-9d38-d1623bd9b718 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:59.057819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314c35-dbe9-45c6-9d38-d1623bd9b718 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:59.059307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 668/1356] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:59.064924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d632-89df-40b4-a8ea-1642e4659882 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:59.065350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d632-89df-40b4-a8ea-1642e4659882 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:59.065486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d632-89df-40b4-a8ea-1642e4659882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:59.089681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0563d632-89df-40b4-a8ea-1642e4659882 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:59.091362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0563d632-89df-40b4-a8ea-1642e4659882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:59.102313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 689/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:24:59.177036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbe9b-413a-4064-83f9-d051077e20c8 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:59.177310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbe9b-413a-4064-83f9-d051077e20c8 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:59.177887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbe9b-413a-4064-83f9-d051077e20c8 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:59.179704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 669/1358] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 19 16:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:24:59.189624 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b4ad8-3cfb-45cb-8454-32326e1a6abc None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:59.190131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b4ad8-3cfb-45cb-8454-32326e1a6abc None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:59.191273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b4ad8-3cfb-45cb-8454-32326e1a6abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:59.258328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-585b4ad8-3cfb-45cb-8454-32326e1a6abc None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:24:59.259932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-585b4ad8-3cfb-45cb-8454-32326e1a6abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:24:59.361730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 690/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 19 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:24:59.369865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbe9b-413a-4064-83f9-d051077e20c8 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:24:59.384996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbe9b-413a-4064-83f9-d051077e20c8 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:24:59.390417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898fe5a-6cae-425c-96d1-158a046bf361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:24:59.391056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898fe5a-6cae-425c-96d1-158a046bf361 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:24:59.391517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898fe5a-6cae-425c-96d1-158a046bf361 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:24:59.392004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898fe5a-6cae-425c-96d1-158a046bf361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:24:59.402970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898fe5a-6cae-425c-96d1-158a046bf361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:24:59.405000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898fe5a-6cae-425c-96d1-158a046bf361 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:24:59.416289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 670/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:01.874602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690803-ce63-4e1d-aa5c-52f94dcedeaf None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:01.875116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690803-ce63-4e1d-aa5c-52f94dcedeaf None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:01.875116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690803-ce63-4e1d-aa5c-52f94dcedeaf None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:01.876682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 691/1361] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:01.882187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9908-2c0e-4862-b2b4-01c55a4bbf7d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:01.882632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9908-2c0e-4862-b2b4-01c55a4bbf7d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:01.882750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9908-2c0e-4862-b2b4-01c55a4bbf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:01.902158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e3ec9908-2c0e-4862-b2b4-01c55a4bbf7d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:01.903343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e3ec9908-2c0e-4862-b2b4-01c55a4bbf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:01.911235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 671/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:01.954764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd690803-ce63-4e1d-aa5c-52f94dcedeaf None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:01.970608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd690803-ce63-4e1d-aa5c-52f94dcedeaf None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:01.976393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bacb3-2b65-4961-b18e-3b74b070a8ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:01.977323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bacb3-2b65-4961-b18e-3b74b070a8ad service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:01.982516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bacb3-2b65-4961-b18e-3b74b070a8ad service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:01.982904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bacb3-2b65-4961-b18e-3b74b070a8ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:01.992080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bacb3-2b65-4961-b18e-3b74b070a8ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:01.993789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bacb3-2b65-4961-b18e-3b74b070a8ad service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:02.003739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 692/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:04.624812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce3c2-c0c5-49f4-8f56-340ec6eaa863 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:04.625344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce3c2-c0c5-49f4-8f56-340ec6eaa863 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:04.625344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce3c2-c0c5-49f4-8f56-340ec6eaa863 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:04.626769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 672/1364] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:04.632679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d9fc8-87c6-48d1-890d-adec2457fe0e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:04.633466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d9fc8-87c6-48d1-890d-adec2457fe0e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:04.633466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d9fc8-87c6-48d1-890d-adec2457fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:04.654618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3c0d9fc8-87c6-48d1-890d-adec2457fe0e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:04.655888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3c0d9fc8-87c6-48d1-890d-adec2457fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:04.679575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 693/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:04.711768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc206-4600-4794-850d-600695d0612e None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:04.712057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc206-4600-4794-850d-600695d0612e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:04.712336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc206-4600-4794-850d-600695d0612e None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:04.713953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 673/1366] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 19 16:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:04.719118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d5b5-8ed8-4f84-9547-9b983249106f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:04.719462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d5b5-8ed8-4f84-9547-9b983249106f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:04.719796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d5b5-8ed8-4f84-9547-9b983249106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:04.738168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3784d5b5-8ed8-4f84-9547-9b983249106f None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:04.739345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3784d5b5-8ed8-4f84-9547-9b983249106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:04.748449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 694/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 19 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:04.756557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc206-4600-4794-850d-600695d0612e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:04.770642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc206-4600-4794-850d-600695d0612e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:04.776802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cea34-f5cf-45e9-8ad1-8c2118b56e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:04.777442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cea34-f5cf-45e9-8ad1-8c2118b56e91 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:04.777725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cea34-f5cf-45e9-8ad1-8c2118b56e91 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:04.778005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cea34-f5cf-45e9-8ad1-8c2118b56e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:04.786022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cea34-f5cf-45e9-8ad1-8c2118b56e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:04.787657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cea34-f5cf-45e9-8ad1-8c2118b56e91 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:04.797237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 674/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:07.102221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab665-95dd-474e-bb57-656cd7a63e2a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.102799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab665-95dd-474e-bb57-656cd7a63e2a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.102799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab665-95dd-474e-bb57-656cd7a63e2a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.104178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 695/1369] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:25:07.109721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eac43-bf6d-4355-af38-1043a529b747 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.110161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eac43-bf6d-4355-af38-1043a529b747 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.110287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eac43-bf6d-4355-af38-1043a529b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.129107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a43eac43-bf6d-4355-af38-1043a529b747 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:07.130305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a43eac43-bf6d-4355-af38-1043a529b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:07.138844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 675/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:07.184094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ab665-95dd-474e-bb57-656cd7a63e2a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:07.199020 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ab665-95dd-474e-bb57-656cd7a63e2a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:07.205720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6ba9f-79ba-4e1f-9737-84806efc7b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:07.206482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6ba9f-79ba-4e1f-9737-84806efc7b28 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.206768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6ba9f-79ba-4e1f-9737-84806efc7b28 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.207043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6ba9f-79ba-4e1f-9737-84806efc7b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.215807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6ba9f-79ba-4e1f-9737-84806efc7b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:07.217529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6ba9f-79ba-4e1f-9737-84806efc7b28 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:07.228287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 696/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:07.475777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb9a1-41b4-4384-b4dd-65774ab3bfbd None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.475978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb9a1-41b4-4384-b4dd-65774ab3bfbd None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.476238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb9a1-41b4-4384-b4dd-65774ab3bfbd None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.477897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 676/1372] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:07.484415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaff7d-c0d7-446e-9532-dca5e9bc9750 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.484785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaff7d-c0d7-446e-9532-dca5e9bc9750 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.485010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaff7d-c0d7-446e-9532-dca5e9bc9750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.504941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-cbeaff7d-c0d7-446e-9532-dca5e9bc9750 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:07.506339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cbeaff7d-c0d7-446e-9532-dca5e9bc9750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:07.519659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 697/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:25:07.833600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c8b18-b803-4087-86dc-20ebb22b494f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.833783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c8b18-b803-4087-86dc-20ebb22b494f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.834859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c8b18-b803-4087-86dc-20ebb22b494f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.836555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 677/1374] 10.222.0.25 () {54 vars in 963 bytes} [Thu May 19 16:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:07.842911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186c3a-4f61-44fa-b2bb-cee3bac101e9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.844017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186c3a-4f61-44fa-b2bb-cee3bac101e9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:07.844321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186c3a-4f61-44fa-b2bb-cee3bac101e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:07.857093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:25:07.905922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b3186c3a-4f61-44fa-b2bb-cee3bac101e9 None None] MFA Rules not processed for user `e01bb2821eec4234917742be62b441ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:07.907151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b3186c3a-4f61-44fa-b2bb-cee3bac101e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:07.979788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 698/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Thu May 19 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:07.983273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c8b18-b803-4087-86dc-20ebb22b494f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:07.994982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c8b18-b803-4087-86dc-20ebb22b494f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:07.998549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7068-cbd1-497f-8abf-862bb51c446d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:07.999372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7068-cbd1-497f-8abf-862bb51c446d service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:07.999938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7068-cbd1-497f-8abf-862bb51c446d service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:08.000386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7068-cbd1-497f-8abf-862bb51c446d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:08.010602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7068-cbd1-497f-8abf-862bb51c446d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:08.012289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7068-cbd1-497f-8abf-862bb51c446d service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:08.023170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 678/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:09.538204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97228e-160d-40d7-b52a-8076a6127cfb None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:09.538826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97228e-160d-40d7-b52a-8076a6127cfb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:09.538826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97228e-160d-40d7-b52a-8076a6127cfb None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:09.540221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 699/1377] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:09.546217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ea347-8c8c-47d8-b4d2-f0eec5840f49 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:09.546789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ea347-8c8c-47d8-b4d2-f0eec5840f49 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:09.546789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ea347-8c8c-47d8-b4d2-f0eec5840f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:09.565535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c09ea347-8c8c-47d8-b4d2-f0eec5840f49 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:09.566876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c09ea347-8c8c-47d8-b4d2-f0eec5840f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:09.574951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 679/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:09.622807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97228e-160d-40d7-b52a-8076a6127cfb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:09.637990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97228e-160d-40d7-b52a-8076a6127cfb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:09.643874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ab5fb-6863-431a-8ece-4b9184608139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:09.644542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab5fb-6863-431a-8ece-4b9184608139 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:09.644822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab5fb-6863-431a-8ece-4b9184608139 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:09.645097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab5fb-6863-431a-8ece-4b9184608139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:09.655204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ab5fb-6863-431a-8ece-4b9184608139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:09.656880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ab5fb-6863-431a-8ece-4b9184608139 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:09.668498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 700/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:11.966638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239a67-a420-43b9-93c6-0becce3c0781 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:11.967286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239a67-a420-43b9-93c6-0becce3c0781 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:11.967286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239a67-a420-43b9-93c6-0becce3c0781 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:11.968617 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 680/1380] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:11.974276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8bd0-e25f-4907-9bb4-bdfec061bc34 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:11.974747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8bd0-e25f-4907-9bb4-bdfec061bc34 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:11.974854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8bd0-e25f-4907-9bb4-bdfec061bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:11.995437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-66fd8bd0-e25f-4907-9bb4-bdfec061bc34 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:11.996772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-66fd8bd0-e25f-4907-9bb4-bdfec061bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:12.005549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 701/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:12.052374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239a67-a420-43b9-93c6-0becce3c0781 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:12.068049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239a67-a420-43b9-93c6-0becce3c0781 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:12.074653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74b40-de6d-4999-a492-63d0a6198a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:12.075549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74b40-de6d-4999-a492-63d0a6198a5f service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:12.076108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74b40-de6d-4999-a492-63d0a6198a5f service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:12.076624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74b40-de6d-4999-a492-63d0a6198a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:12.085946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74b40-de6d-4999-a492-63d0a6198a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:12.087841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74b40-de6d-4999-a492-63d0a6198a5f service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:12.099942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 681/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:14.374505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420ac1-c9a1-459b-bc58-a250e2a9833c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:14.375130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420ac1-c9a1-459b-bc58-a250e2a9833c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:14.375130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420ac1-c9a1-459b-bc58-a250e2a9833c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:14.376637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 702/1383] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:14.381983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d8cfb-7b48-4398-8ea0-18e7016726c5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:14.382779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d8cfb-7b48-4398-8ea0-18e7016726c5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:14.383234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d8cfb-7b48-4398-8ea0-18e7016726c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:14.401492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b00d8cfb-7b48-4398-8ea0-18e7016726c5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:14.402921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b00d8cfb-7b48-4398-8ea0-18e7016726c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:14.416057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 682/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:14.454412 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420ac1-c9a1-459b-bc58-a250e2a9833c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:14.470471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420ac1-c9a1-459b-bc58-a250e2a9833c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:14.477006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c76ba-cdaf-4fec-8d1d-856a21e8c8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:14.477845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c76ba-cdaf-4fec-8d1d-856a21e8c8bf service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:14.478285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c76ba-cdaf-4fec-8d1d-856a21e8c8bf service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:14.478719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c76ba-cdaf-4fec-8d1d-856a21e8c8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:14.487845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c76ba-cdaf-4fec-8d1d-856a21e8c8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:14.489622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c76ba-cdaf-4fec-8d1d-856a21e8c8bf service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:14.499970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 703/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:16.938894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e23e8-bb04-4f0b-a29a-30e43589422c None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:16.939558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e23e8-bb04-4f0b-a29a-30e43589422c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:16.939558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e23e8-bb04-4f0b-a29a-30e43589422c None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:16.940886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 683/1386] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:16.946913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90837800-f77b-44b5-9ebd-410469854eb3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:16.947372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90837800-f77b-44b5-9ebd-410469854eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:16.947685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90837800-f77b-44b5-9ebd-410469854eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:16.969641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-90837800-f77b-44b5-9ebd-410469854eb3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:16.971111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-90837800-f77b-44b5-9ebd-410469854eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:16.981712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 704/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:17.028107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e23e8-bb04-4f0b-a29a-30e43589422c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:17.043988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e23e8-bb04-4f0b-a29a-30e43589422c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:17.050814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e33d84-9281-4956-bc1b-5fd55de33d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:17.051761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e33d84-9281-4956-bc1b-5fd55de33d6c service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:17.052168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e33d84-9281-4956-bc1b-5fd55de33d6c service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:17.053336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e33d84-9281-4956-bc1b-5fd55de33d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:17.064429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e33d84-9281-4956-bc1b-5fd55de33d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:17.066470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e33d84-9281-4956-bc1b-5fd55de33d6c service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:17.078720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 684/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:19.414249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15600-c6ce-4c4a-a842-956379e8e854 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:19.414819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15600-c6ce-4c4a-a842-956379e8e854 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:19.414960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15600-c6ce-4c4a-a842-956379e8e854 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:19.416841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 705/1389] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:19.422830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecb3aa-3351-4f7c-a39b-04275f6b63a1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:19.423261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecb3aa-3351-4f7c-a39b-04275f6b63a1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:19.423545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecb3aa-3351-4f7c-a39b-04275f6b63a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:19.446054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-baecb3aa-3351-4f7c-a39b-04275f6b63a1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:19.447529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-baecb3aa-3351-4f7c-a39b-04275f6b63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:19.457332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 685/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:19.509719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15600-c6ce-4c4a-a842-956379e8e854 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:19.525827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15600-c6ce-4c4a-a842-956379e8e854 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:19.531894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e6778-8da2-4a5a-a91c-c113af8b4ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:19.532507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e6778-8da2-4a5a-a91c-c113af8b4ada service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:19.532786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e6778-8da2-4a5a-a91c-c113af8b4ada service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:19.533058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e6778-8da2-4a5a-a91c-c113af8b4ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:19.542509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e6778-8da2-4a5a-a91c-c113af8b4ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:19.544140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e6778-8da2-4a5a-a91c-c113af8b4ada service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:19.554108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 706/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:21.846976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1183a4-f42a-4d14-82ea-a3762630b42f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:21.847669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1183a4-f42a-4d14-82ea-a3762630b42f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:21.847860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1183a4-f42a-4d14-82ea-a3762630b42f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:21.849486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 686/1392] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:21.854905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a827-7fe5-4f97-92b4-f57eb804fb1a None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:21.855511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a827-7fe5-4f97-92b4-f57eb804fb1a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:21.855511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a827-7fe5-4f97-92b4-f57eb804fb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:21.874028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1fe2a827-7fe5-4f97-92b4-f57eb804fb1a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:21.875231 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1fe2a827-7fe5-4f97-92b4-f57eb804fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:21.883952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 707/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:21.928116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1183a4-f42a-4d14-82ea-a3762630b42f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:21.942546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1183a4-f42a-4d14-82ea-a3762630b42f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:21.948680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ee36b-e98b-42a4-9784-428a444cb5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:21.949447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ee36b-e98b-42a4-9784-428a444cb5a4 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:21.949745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ee36b-e98b-42a4-9784-428a444cb5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:21.950054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ee36b-e98b-42a4-9784-428a444cb5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:21.959834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ee36b-e98b-42a4-9784-428a444cb5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:21.961462 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ee36b-e98b-42a4-9784-428a444cb5a4 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:21.971425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 687/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:24.005928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9546b8f-109e-46a2-a4a5-bdc4a0aae83c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.006395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9546b8f-109e-46a2-a4a5-bdc4a0aae83c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.006503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9546b8f-109e-46a2-a4a5-bdc4a0aae83c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.007905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 708/1395] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:24.013080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0be33-2b2c-4447-bb23-a7bb3d657273 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.013523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0be33-2b2c-4447-bb23-a7bb3d657273 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.013654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0be33-2b2c-4447-bb23-a7bb3d657273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.019658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=52 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:25:24.034407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e2b0be33-2b2c-4447-bb23-a7bb3d657273 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:24.035673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e2b0be33-2b2c-4447-bb23-a7bb3d657273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:24.044639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 688/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:24.100677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fec9-7a1a-4a49-b1cd-bb8010ca27da None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.100996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fec9-7a1a-4a49-b1cd-bb8010ca27da None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.101278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fec9-7a1a-4a49-b1cd-bb8010ca27da None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.102653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 709/1397] 10.222.0.25 () {54 vars in 962 bytes} [Thu May 19 16:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:24.107570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056c30-398c-4e8d-adde-71ac3cffc75a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.107905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056c30-398c-4e8d-adde-71ac3cffc75a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.108187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056c30-398c-4e8d-adde-71ac3cffc75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.156426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d1056c30-398c-4e8d-adde-71ac3cffc75a None None] MFA Rules not processed for user `e9abdf0cdb63429d926f201034fb72ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:24.157622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d1056c30-398c-4e8d-adde-71ac3cffc75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:24.217225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9cb9-d4a2-49d5-a276-cd39eb295be2 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.217458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 689/1398] 10.222.0.25 () {58 vars in 1059 bytes} [Thu May 19 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:25:24.217571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9cb9-d4a2-49d5-a276-cd39eb295be2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.217841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9cb9-d4a2-49d5-a276-cd39eb295be2 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.219285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 710/1399] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:25:24.225148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f9cb9-d4a2-49d5-a276-cd39eb295be2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:24.225403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.225700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.225982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.235750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f9cb9-d4a2-49d5-a276-cd39eb295be2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:24.239244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591880b-cd33-43d5-b0e9-171c60ee446c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:24.239896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591880b-cd33-43d5-b0e9-171c60ee446c service glance] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.240210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591880b-cd33-43d5-b0e9-171c60ee446c service glance] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.240483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591880b-cd33-43d5-b0e9-171c60ee446c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.243454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:24.244667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:24.249493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591880b-cd33-43d5-b0e9-171c60ee446c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:24.250937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591880b-cd33-43d5-b0e9-171c60ee446c service glance] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:24.252596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 690/1400] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:25:24.261322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 711/1401] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:25:24.297317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:24.309418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d938ba-341d-490d-bcdf-66d2f3d6b8c5 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:24.314878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc70dd2-d71a-493a-b8c1-e3a220bda355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:24.316201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc70dd2-d71a-493a-b8c1-e3a220bda355 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.316488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc70dd2-d71a-493a-b8c1-e3a220bda355 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.316770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc70dd2-d71a-493a-b8c1-e3a220bda355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.325534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc70dd2-d71a-493a-b8c1-e3a220bda355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:24.327116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc70dd2-d71a-493a-b8c1-e3a220bda355 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:24.337069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 691/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:24.809722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc2ab1-9d37-4609-956d-b93ad132cb1d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.810085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc2ab1-9d37-4609-956d-b93ad132cb1d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.810461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc2ab1-9d37-4609-956d-b93ad132cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.860455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-44bc2ab1-9d37-4609-956d-b93ad132cb1d None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:24.861656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-44bc2ab1-9d37-4609-956d-b93ad132cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:24.908097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:25:24.932872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 712/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:24.978651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc333b7-356a-4cb1-af07-3c0a98b066ea None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.978945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc333b7-356a-4cb1-af07-3c0a98b066ea None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.979231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc333b7-356a-4cb1-af07-3c0a98b066ea None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:24.980675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 692/1404] 10.222.0.25 () {54 vars in 942 bytes} [Thu May 19 16:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:24.987188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20b5a-943f-46a9-a910-241bdc368b40 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:24.987420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20b5a-943f-46a9-a910-241bdc368b40 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:24.987761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20b5a-943f-46a9-a910-241bdc368b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:25.036713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-96f20b5a-943f-46a9-a910-241bdc368b40 None None] MFA Rules not processed for user `d270113b79534fadbb15eb81eb547a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:25.038413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-96f20b5a-943f-46a9-a910-241bdc368b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:25.111433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 713/1405] 10.222.0.25 () {58 vars in 1039 bytes} [Thu May 19 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:25.121281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc333b7-356a-4cb1-af07-3c0a98b066ea None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:25.134562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc333b7-356a-4cb1-af07-3c0a98b066ea None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:25.139476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d1131-d36c-4019-a406-4c3838c272aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:25.140152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1131-d36c-4019-a406-4c3838c272aa service swift] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:25.140432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1131-d36c-4019-a406-4c3838c272aa service swift] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:25.140709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1131-d36c-4019-a406-4c3838c272aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:25.149655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d1131-d36c-4019-a406-4c3838c272aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:25.151240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d1131-d36c-4019-a406-4c3838c272aa service swift] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:25.159211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 693/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:25:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:25:26.629343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb668a6-69be-4c07-9a3f-7a206c2ee124 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:26.629900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb668a6-69be-4c07-9a3f-7a206c2ee124 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:26.629900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb668a6-69be-4c07-9a3f-7a206c2ee124 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:26.631429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 714/1407] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:25:26.636751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79fcb-2954-4953-bc2a-54f9256625cb None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:26.637528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79fcb-2954-4953-bc2a-54f9256625cb None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:26.637817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79fcb-2954-4953-bc2a-54f9256625cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:26.656065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-29e79fcb-2954-4953-bc2a-54f9256625cb None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:26.657288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-29e79fcb-2954-4953-bc2a-54f9256625cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:26.666107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 694/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:26.712193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb668a6-69be-4c07-9a3f-7a206c2ee124 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:26.728446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb668a6-69be-4c07-9a3f-7a206c2ee124 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:26.734462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6c593-6b06-42ea-b49a-288b144dd23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:26.738455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6c593-6b06-42ea-b49a-288b144dd23f service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:26.738455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6c593-6b06-42ea-b49a-288b144dd23f service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:26.738455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6c593-6b06-42ea-b49a-288b144dd23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:26.746099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6c593-6b06-42ea-b49a-288b144dd23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:26.747753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6c593-6b06-42ea-b49a-288b144dd23f service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:26.757539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 715/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:36.650671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=58 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:25:36.753618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=59 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:25:50.532342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3fcfb-783f-45e9-b8ec-e4ea15989112 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:50.532979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3fcfb-783f-45e9-b8ec-e4ea15989112 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:50.532979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3fcfb-783f-45e9-b8ec-e4ea15989112 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:50.534269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 695/1410] 10.222.0.25 () {54 vars in 918 bytes} [Thu May 19 16:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:50.539836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7368abb-5ba4-456a-ae8f-8f3a2ac5a1e6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:50.540275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7368abb-5ba4-456a-ae8f-8f3a2ac5a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:50.540384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7368abb-5ba4-456a-ae8f-8f3a2ac5a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:50.558982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c7368abb-5ba4-456a-ae8f-8f3a2ac5a1e6 None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:50.560207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c7368abb-5ba4-456a-ae8f-8f3a2ac5a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:50.568766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 716/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 19 16:25:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:50.586303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5e7b-2391-4391-b0ba-5087a0e20592 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:50.586596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5e7b-2391-4391-b0ba-5087a0e20592 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:50.587156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5e7b-2391-4391-b0ba-5087a0e20592 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:50.588599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 696/1412] 10.222.0.25 () {54 vars in 918 bytes} [Thu May 19 16:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:25:50.593509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80e08-d188-4a27-9207-a9cd721fc23a None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:50.593802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80e08-d188-4a27-9207-a9cd721fc23a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:50.594087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80e08-d188-4a27-9207-a9cd721fc23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:50.613291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0ab80e08-d188-4a27-9207-a9cd721fc23a None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:50.615128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0ab80e08-d188-4a27-9207-a9cd721fc23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:50.624425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 717/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 19 16:25:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:25:53.328467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14045c-180d-4425-8381-217941ca4335 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:53.329012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14045c-180d-4425-8381-217941ca4335 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:53.329012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14045c-180d-4425-8381-217941ca4335 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:53.330320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:53.335731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0239ad-ce34-45db-b5f7-69392fe293e3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:53.336180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0239ad-ce34-45db-b5f7-69392fe293e3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:53.336298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0239ad-ce34-45db-b5f7-69392fe293e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:53.353712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8e0239ad-ce34-45db-b5f7-69392fe293e3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:53.354906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8e0239ad-ce34-45db-b5f7-69392fe293e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:53.362698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:53.406664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14045c-180d-4425-8381-217941ca4335 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:53.421543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14045c-180d-4425-8381-217941ca4335 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:53.426839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ace7f0-22bc-476f-b53f-b6d5c79530eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:53.429911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ace7f0-22bc-476f-b53f-b6d5c79530eb service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:53.430201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ace7f0-22bc-476f-b53f-b6d5c79530eb service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:53.430920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ace7f0-22bc-476f-b53f-b6d5c79530eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:53.440711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ace7f0-22bc-476f-b53f-b6d5c79530eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:53.442307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ace7f0-22bc-476f-b53f-b6d5c79530eb service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:53.452408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 698/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:54.431376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb8fa-0966-41ad-b58e-11967f7a0db1 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:54.431990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb8fa-0966-41ad-b58e-11967f7a0db1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:54.431990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb8fa-0966-41ad-b58e-11967f7a0db1 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:54.433346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:54.438169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a969-8bbb-407b-8fbb-a85ddbc835e1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:54.438593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a969-8bbb-407b-8fbb-a85ddbc835e1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:54.438744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a969-8bbb-407b-8fbb-a85ddbc835e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:54.456945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5f02a969-8bbb-407b-8fbb-a85ddbc835e1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:54.458717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5f02a969-8bbb-407b-8fbb-a85ddbc835e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:54.466499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:54.625300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb8fa-0966-41ad-b58e-11967f7a0db1 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:54.640417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb8fa-0966-41ad-b58e-11967f7a0db1 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:54.645899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1290-0fa6-44b7-9ab3-86679ce436d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:54.646803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1290-0fa6-44b7-9ab3-86679ce436d1 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:54.647089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1290-0fa6-44b7-9ab3-86679ce436d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:54.647367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1290-0fa6-44b7-9ab3-86679ce436d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:54.656696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1290-0fa6-44b7-9ab3-86679ce436d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:54.658323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1290-0fa6-44b7-9ab3-86679ce436d1 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:54.668159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 720/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:55.637373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a84bb7-e9a0-4b3f-b31e-a423012a0b08 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:55.637956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a84bb7-e9a0-4b3f-b31e-a423012a0b08 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:55.637956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a84bb7-e9a0-4b3f-b31e-a423012a0b08 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:55.639357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:55.644413 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0ff52-c1dc-45c4-b078-49c9e5ec34ab None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:55.644826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0ff52-c1dc-45c4-b078-49c9e5ec34ab None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:55.644974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0ff52-c1dc-45c4-b078-49c9e5ec34ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:55.663008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b9a0ff52-c1dc-45c4-b078-49c9e5ec34ab None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:55.664270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b9a0ff52-c1dc-45c4-b078-49c9e5ec34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:55.672137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:55.822962 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a84bb7-e9a0-4b3f-b31e-a423012a0b08 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:55.837208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a84bb7-e9a0-4b3f-b31e-a423012a0b08 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:55.842505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a117ea-21bc-477e-bd82-3f288c8923d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:55.843136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a117ea-21bc-477e-bd82-3f288c8923d3 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:55.843420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a117ea-21bc-477e-bd82-3f288c8923d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:55.843729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a117ea-21bc-477e-bd82-3f288c8923d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:55.852174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a117ea-21bc-477e-bd82-3f288c8923d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:55.853751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a117ea-21bc-477e-bd82-3f288c8923d3 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:55.862898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 701/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:56.788577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b6ed-ead5-455e-bcd8-2ec2096727ff None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:56.789156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b6ed-ead5-455e-bcd8-2ec2096727ff None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:56.789156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b6ed-ead5-455e-bcd8-2ec2096727ff None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:56.790528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:56.795447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718067-21a7-47c3-b22e-b4b7e48c8b4d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:56.795937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718067-21a7-47c3-b22e-b4b7e48c8b4d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:56.796047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718067-21a7-47c3-b22e-b4b7e48c8b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:56.814476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5c718067-21a7-47c3-b22e-b4b7e48c8b4d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:56.815714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5c718067-21a7-47c3-b22e-b4b7e48c8b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:56.823588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:56.974402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b6ed-ead5-455e-bcd8-2ec2096727ff None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:56.988735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b6ed-ead5-455e-bcd8-2ec2096727ff None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:56.994419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faab5b2-c264-48ab-9e2d-19acbaf12f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:56.995062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faab5b2-c264-48ab-9e2d-19acbaf12f1a service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:56.995352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faab5b2-c264-48ab-9e2d-19acbaf12f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:56.995667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faab5b2-c264-48ab-9e2d-19acbaf12f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:57.004932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faab5b2-c264-48ab-9e2d-19acbaf12f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:57.006568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faab5b2-c264-48ab-9e2d-19acbaf12f1a service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:57.017201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 723/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:57.965906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543d2d-3409-4430-9683-b241b0c5ce03 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:57.966477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543d2d-3409-4430-9683-b241b0c5ce03 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:57.966477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543d2d-3409-4430-9683-b241b0c5ce03 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:57.967893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:57.973002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723393-554b-4c5a-a11b-a694aec52cb4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:57.973436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723393-554b-4c5a-a11b-a694aec52cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:57.973564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723393-554b-4c5a-a11b-a694aec52cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:57.992286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ba723393-554b-4c5a-a11b-a694aec52cb4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:57.993496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ba723393-554b-4c5a-a11b-a694aec52cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:58.001929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:58.153952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543d2d-3409-4430-9683-b241b0c5ce03 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:58.169166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543d2d-3409-4430-9683-b241b0c5ce03 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:58.174727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafb702-d240-481f-a6c6-5bb32195feb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:58.175379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafb702-d240-481f-a6c6-5bb32195feb7 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:58.175703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafb702-d240-481f-a6c6-5bb32195feb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:58.175987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafb702-d240-481f-a6c6-5bb32195feb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:58.184606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafb702-d240-481f-a6c6-5bb32195feb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:58.186212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafb702-d240-481f-a6c6-5bb32195feb7 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:58.196411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 704/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:25:59.086939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285a07-e344-4b2d-85a3-412bdb2c6f74 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:59.087479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285a07-e344-4b2d-85a3-412bdb2c6f74 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:59.087479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285a07-e344-4b2d-85a3-412bdb2c6f74 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:59.088913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:25:59.093815 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a0f2-ac43-4639-9d1d-0cf23d9bf5a5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:59.094247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a0f2-ac43-4639-9d1d-0cf23d9bf5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:59.094414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a0f2-ac43-4639-9d1d-0cf23d9bf5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:59.113855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a462a0f2-ac43-4639-9d1d-0cf23d9bf5a5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:25:59.115652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a462a0f2-ac43-4639-9d1d-0cf23d9bf5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:25:59.123839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:25:59.276393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285a07-e344-4b2d-85a3-412bdb2c6f74 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:25:59.294504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285a07-e344-4b2d-85a3-412bdb2c6f74 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:25:59.300138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dce532-8333-4cf4-a915-5770ae15717e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:25:59.300796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dce532-8333-4cf4-a915-5770ae15717e service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:25:59.301082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dce532-8333-4cf4-a915-5770ae15717e service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:25:59.301358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dce532-8333-4cf4-a915-5770ae15717e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:25:59.310635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dce532-8333-4cf4-a915-5770ae15717e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:25:59.312309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dce532-8333-4cf4-a915-5770ae15717e service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:25:59.322402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 726/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:00.210497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeae362-e016-4289-aec0-1fe50f603659 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:00.211047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeae362-e016-4289-aec0-1fe50f603659 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:00.211047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeae362-e016-4289-aec0-1fe50f603659 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:00.212367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:00.217148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277b55-b4bb-4e7f-8955-828c4c98d8a0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:00.217569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277b55-b4bb-4e7f-8955-828c4c98d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:00.217762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277b55-b4bb-4e7f-8955-828c4c98d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:00.236192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-97277b55-b4bb-4e7f-8955-828c4c98d8a0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:00.237393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-97277b55-b4bb-4e7f-8955-828c4c98d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:00.245837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:00.395804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeae362-e016-4289-aec0-1fe50f603659 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:00.410204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeae362-e016-4289-aec0-1fe50f603659 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:00.416105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eac70a-002d-4cb9-b8ac-cf4761f282d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:00.416777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac70a-002d-4cb9-b8ac-cf4761f282d9 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:00.417064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac70a-002d-4cb9-b8ac-cf4761f282d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:00.417341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac70a-002d-4cb9-b8ac-cf4761f282d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:00.425832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eac70a-002d-4cb9-b8ac-cf4761f282d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:00.428053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eac70a-002d-4cb9-b8ac-cf4761f282d9 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:00.437901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 707/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:01.314258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc63a4-d27f-4dae-9c12-8e8c29a4c8a5 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:01.314777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc63a4-d27f-4dae-9c12-8e8c29a4c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:01.314777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc63a4-d27f-4dae-9c12-8e8c29a4c8a5 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:01.316205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:01.321727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe41df-acec-492e-89e6-a24ac0c7104c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:01.322165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe41df-acec-492e-89e6-a24ac0c7104c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:01.322279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe41df-acec-492e-89e6-a24ac0c7104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:01.341144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-40fe41df-acec-492e-89e6-a24ac0c7104c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:01.342346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-40fe41df-acec-492e-89e6-a24ac0c7104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:01.350198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:01.530014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc63a4-d27f-4dae-9c12-8e8c29a4c8a5 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:01.544224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc63a4-d27f-4dae-9c12-8e8c29a4c8a5 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:01.549542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a92935-4f49-4942-b7a8-121315cec1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:01.550177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92935-4f49-4942-b7a8-121315cec1ec service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:01.550462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92935-4f49-4942-b7a8-121315cec1ec service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:01.550740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92935-4f49-4942-b7a8-121315cec1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:01.559535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a92935-4f49-4942-b7a8-121315cec1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:01.561239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a92935-4f49-4942-b7a8-121315cec1ec service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:01.571421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 729/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:02.447728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62887bd0-97e9-40ce-b78f-aa214e02191a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:02.448280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62887bd0-97e9-40ce-b78f-aa214e02191a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:02.448280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62887bd0-97e9-40ce-b78f-aa214e02191a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:02.449654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:02.454600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34be5-24ec-4e3c-af64-54f55b02fb40 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:02.455021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34be5-24ec-4e3c-af64-54f55b02fb40 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:02.455157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34be5-24ec-4e3c-af64-54f55b02fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:02.476678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-69c34be5-24ec-4e3c-af64-54f55b02fb40 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:02.477872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-69c34be5-24ec-4e3c-af64-54f55b02fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:02.485573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:02.635852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62887bd0-97e9-40ce-b78f-aa214e02191a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:02.650105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62887bd0-97e9-40ce-b78f-aa214e02191a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:02.655328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac294-d6dd-4d69-934a-29ab5f0b94a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:02.655986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac294-d6dd-4d69-934a-29ab5f0b94a9 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:02.656269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac294-d6dd-4d69-934a-29ab5f0b94a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:02.656544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac294-d6dd-4d69-934a-29ab5f0b94a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:02.665210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac294-d6dd-4d69-934a-29ab5f0b94a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:02.666799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac294-d6dd-4d69-934a-29ab5f0b94a9 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:02.676054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 710/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:04.866698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5aa50-ab94-4b2f-b506-c3e7c6375430 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:04.867266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5aa50-ab94-4b2f-b506-c3e7c6375430 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:04.867266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5aa50-ab94-4b2f-b506-c3e7c6375430 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:04.868657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:04.873995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6313-981e-426b-b2fd-dfa9d2bb48c6 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:04.874466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6313-981e-426b-b2fd-dfa9d2bb48c6 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:04.874563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6313-981e-426b-b2fd-dfa9d2bb48c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:04.892778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e47f6313-981e-426b-b2fd-dfa9d2bb48c6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:04.893908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e47f6313-981e-426b-b2fd-dfa9d2bb48c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:04.902566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:04.939588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5aa50-ab94-4b2f-b506-c3e7c6375430 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:04.950574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5aa50-ab94-4b2f-b506-c3e7c6375430 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:04.953980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3851f73-1a88-43e7-ad8f-ac1ca74b7426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:04.954606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851f73-1a88-43e7-ad8f-ac1ca74b7426 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:04.954882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851f73-1a88-43e7-ad8f-ac1ca74b7426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:04.955151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851f73-1a88-43e7-ad8f-ac1ca74b7426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:04.964683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3851f73-1a88-43e7-ad8f-ac1ca74b7426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:04.966153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3851f73-1a88-43e7-ad8f-ac1ca74b7426 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:04.975772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 732/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:07.445073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69a56-2bde-4a6b-989a-0bc5cfadfaf7 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:07.445618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69a56-2bde-4a6b-989a-0bc5cfadfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:07.445618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69a56-2bde-4a6b-989a-0bc5cfadfaf7 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:07.447003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:07.452185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726b1ee-3a1f-40ec-bc36-eb570f993cbf None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:07.452607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726b1ee-3a1f-40ec-bc36-eb570f993cbf None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:07.452746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726b1ee-3a1f-40ec-bc36-eb570f993cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:07.470789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0726b1ee-3a1f-40ec-bc36-eb570f993cbf None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:07.472044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0726b1ee-3a1f-40ec-bc36-eb570f993cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:07.480410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:07.517454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc69a56-2bde-4a6b-989a-0bc5cfadfaf7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:07.529229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc69a56-2bde-4a6b-989a-0bc5cfadfaf7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:07.532874 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b9ab8-3454-4f90-82f7-d43bb058d2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:07.533513 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b9ab8-3454-4f90-82f7-d43bb058d2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:07.533794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b9ab8-3454-4f90-82f7-d43bb058d2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:07.534074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b9ab8-3454-4f90-82f7-d43bb058d2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:07.544407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b9ab8-3454-4f90-82f7-d43bb058d2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:07.545854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b9ab8-3454-4f90-82f7-d43bb058d2fb service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:07.555889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 713/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:10.247570 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9257-98a9-4b12-8c41-f95da59af8b9 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:10.248338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9257-98a9-4b12-8c41-f95da59af8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:10.248338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9257-98a9-4b12-8c41-f95da59af8b9 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:10.249561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:10.256502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ea86-f3ff-45f4-8620-5b1d8a4f0219 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:10.257148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ea86-f3ff-45f4-8620-5b1d8a4f0219 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:10.257148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ea86-f3ff-45f4-8620-5b1d8a4f0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:10.278290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-95c5ea86-f3ff-45f4-8620-5b1d8a4f0219 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:10.279533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-95c5ea86-f3ff-45f4-8620-5b1d8a4f0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:10.288851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:10.350028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9257-98a9-4b12-8c41-f95da59af8b9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:10.362265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9257-98a9-4b12-8c41-f95da59af8b9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:10.367214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6c6c-7333-4dd8-b7ee-3133eaac476a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:10.367930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6c6c-7333-4dd8-b7ee-3133eaac476a service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:10.368215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6c6c-7333-4dd8-b7ee-3133eaac476a service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:10.368494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6c6c-7333-4dd8-b7ee-3133eaac476a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:10.379431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd6c6c-7333-4dd8-b7ee-3133eaac476a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:10.380960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd6c6c-7333-4dd8-b7ee-3133eaac476a service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:10.392183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 735/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:26:12.989449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166f87-c9fa-4f62-be59-372ef9ad2e2f None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:12.990048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166f87-c9fa-4f62-be59-372ef9ad2e2f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:12.990048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166f87-c9fa-4f62-be59-372ef9ad2e2f None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:12.991381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:26:12.997053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e813b6-dbba-421c-a346-cb02bbe62c2c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:12.997549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e813b6-dbba-421c-a346-cb02bbe62c2c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:12.997692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e813b6-dbba-421c-a346-cb02bbe62c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:13.016238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-10e813b6-dbba-421c-a346-cb02bbe62c2c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:13.017439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-10e813b6-dbba-421c-a346-cb02bbe62c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:13.031065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:26:13.069327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166f87-c9fa-4f62-be59-372ef9ad2e2f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:13.080215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166f87-c9fa-4f62-be59-372ef9ad2e2f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:13.084472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650d27-52cf-485c-a66a-c4410cbeeb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:13.085114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650d27-52cf-485c-a66a-c4410cbeeb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:13.085397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650d27-52cf-485c-a66a-c4410cbeeb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:13.085674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650d27-52cf-485c-a66a-c4410cbeeb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:13.095266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df650d27-52cf-485c-a66a-c4410cbeeb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:13.096730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df650d27-52cf-485c-a66a-c4410cbeeb54 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:13.107606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 716/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:15.604971 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2abb-8d2a-4550-9855-3de47eb3368e None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:15.605895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2abb-8d2a-4550-9855-3de47eb3368e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:15.605895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2abb-8d2a-4550-9855-3de47eb3368e None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:15.606900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:15.613228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30f802-1a25-48f0-b622-7c7b7c099878 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:15.613827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30f802-1a25-48f0-b622-7c7b7c099878 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:15.613827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30f802-1a25-48f0-b622-7c7b7c099878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:15.633947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-9a30f802-1a25-48f0-b622-7c7b7c099878 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:15.635174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9a30f802-1a25-48f0-b622-7c7b7c099878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:15.643853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:26:15.682988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2abb-8d2a-4550-9855-3de47eb3368e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:15.695253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2abb-8d2a-4550-9855-3de47eb3368e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:15.698911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fdc63-201e-4a02-9103-3da52c7034ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:15.699704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fdc63-201e-4a02-9103-3da52c7034ef service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:15.700093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fdc63-201e-4a02-9103-3da52c7034ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:15.700486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fdc63-201e-4a02-9103-3da52c7034ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:15.710988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fdc63-201e-4a02-9103-3da52c7034ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:15.712492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fdc63-201e-4a02-9103-3da52c7034ef service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:15.725686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 738/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:18.125187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd85e52-0fbb-45d1-b0a4-61ee4bca6ca0 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:18.125776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd85e52-0fbb-45d1-b0a4-61ee4bca6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:18.125776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd85e52-0fbb-45d1-b0a4-61ee4bca6ca0 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:18.127120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:18.133293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fa003-7ceb-4db1-b57c-4034bdf87532 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:18.133763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fa003-7ceb-4db1-b57c-4034bdf87532 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:18.133869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fa003-7ceb-4db1-b57c-4034bdf87532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:18.139896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=70 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:26:18.153035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2c8fa003-7ceb-4db1-b57c-4034bdf87532 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:18.154150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2c8fa003-7ceb-4db1-b57c-4034bdf87532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:18.161889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:18.200310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd85e52-0fbb-45d1-b0a4-61ee4bca6ca0 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:18.205743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=64 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:26:18.212400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd85e52-0fbb-45d1-b0a4-61ee4bca6ca0 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:18.215899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f491-55a4-48fa-8f26-b81d7a0d1a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:18.217523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f491-55a4-48fa-8f26-b81d7a0d1a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:18.217523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f491-55a4-48fa-8f26-b81d7a0d1a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:18.217523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f491-55a4-48fa-8f26-b81d7a0d1a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:18.227530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54f491-55a4-48fa-8f26-b81d7a0d1a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:18.229014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54f491-55a4-48fa-8f26-b81d7a0d1a30 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:18.238871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 719/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:20.579490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1c44-fec3-4ddd-a4da-d3e1084fad8a None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:20.580165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1c44-fec3-4ddd-a4da-d3e1084fad8a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:20.580165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1c44-fec3-4ddd-a4da-d3e1084fad8a None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:20.581463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:20.587884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cea67-61b4-42a5-8021-b9cd38be8f71 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:20.588646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cea67-61b4-42a5-8021-b9cd38be8f71 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:20.588836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cea67-61b4-42a5-8021-b9cd38be8f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:20.606869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-370cea67-61b4-42a5-8021-b9cd38be8f71 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:20.608129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-370cea67-61b4-42a5-8021-b9cd38be8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:20.616177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:20.655171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca1c44-fec3-4ddd-a4da-d3e1084fad8a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:20.656912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b9ca1c44-fec3-4ddd-a4da-d3e1084fad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:20.670721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca1c44-fec3-4ddd-a4da-d3e1084fad8a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:20.674284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fe54f-8a0c-47f1-a398-9c9acc2cf4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:20.674932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe54f-8a0c-47f1-a398-9c9acc2cf4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:20.675214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe54f-8a0c-47f1-a398-9c9acc2cf4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:20.675488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe54f-8a0c-47f1-a398-9c9acc2cf4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:20.685485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fe54f-8a0c-47f1-a398-9c9acc2cf4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:20.686957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fe54f-8a0c-47f1-a398-9c9acc2cf4cb service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:20.697480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 741/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:23.044489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea090-81c2-4874-bfb8-fa10709a1301 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:23.045066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea090-81c2-4874-bfb8-fa10709a1301 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:23.045066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea090-81c2-4874-bfb8-fa10709a1301 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:23.046478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:23.053327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29a913-fc2d-445a-9a13-0b5ba160ad44 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:23.053839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29a913-fc2d-445a-9a13-0b5ba160ad44 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:23.053967 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29a913-fc2d-445a-9a13-0b5ba160ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:23.072344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-fb29a913-fc2d-445a-9a13-0b5ba160ad44 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:23.073549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fb29a913-fc2d-445a-9a13-0b5ba160ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:23.081461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:23.119574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea090-81c2-4874-bfb8-fa10709a1301 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:23.130225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea090-81c2-4874-bfb8-fa10709a1301 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:23.133815 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b46d9d-d558-45d3-a624-7d3295d1a7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:23.134448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46d9d-d558-45d3-a624-7d3295d1a7ba service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:23.134730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46d9d-d558-45d3-a624-7d3295d1a7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:23.135005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46d9d-d558-45d3-a624-7d3295d1a7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:23.144181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b46d9d-d558-45d3-a624-7d3295d1a7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:23.146540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b46d9d-d558-45d3-a624-7d3295d1a7ba service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:23.156127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 722/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:26:25.417068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c72e7-835b-4ee9-9d26-53c75f2c284e None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:25.417633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c72e7-835b-4ee9-9d26-53c75f2c284e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:25.417749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c72e7-835b-4ee9-9d26-53c75f2c284e None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:25.419232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:25.425015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4826e8-c895-4cd4-8ee0-2fa43d444ed4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:25.425490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4826e8-c895-4cd4-8ee0-2fa43d444ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:25.425591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4826e8-c895-4cd4-8ee0-2fa43d444ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:25.443078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4c4826e8-c895-4cd4-8ee0-2fa43d444ed4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:25.444314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4c4826e8-c895-4cd4-8ee0-2fa43d444ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:25.452229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:26:25.489428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c72e7-835b-4ee9-9d26-53c75f2c284e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:25.500216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c72e7-835b-4ee9-9d26-53c75f2c284e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:25.503750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a2909-90da-4d0b-b23f-e648cd22b37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:25.504392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a2909-90da-4d0b-b23f-e648cd22b37e service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:25.504675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a2909-90da-4d0b-b23f-e648cd22b37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:25.504952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a2909-90da-4d0b-b23f-e648cd22b37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:25.514174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a2909-90da-4d0b-b23f-e648cd22b37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:25.515642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a2909-90da-4d0b-b23f-e648cd22b37e service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:25.526578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 744/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:27.833830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff998f0-d756-4224-aa29-ab58a8099e85 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:27.834425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff998f0-d756-4224-aa29-ab58a8099e85 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:27.834425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff998f0-d756-4224-aa29-ab58a8099e85 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:27.835797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:26:27.841524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec4363-f379-414a-bfeb-c6b3719d0459 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:27.842041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec4363-f379-414a-bfeb-c6b3719d0459 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:27.842306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec4363-f379-414a-bfeb-c6b3719d0459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:27.860801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9bec4363-f379-414a-bfeb-c6b3719d0459 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:26:27.861994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9bec4363-f379-414a-bfeb-c6b3719d0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:26:27.869795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:26:27.907075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff998f0-d756-4224-aa29-ab58a8099e85 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:26:27.918861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff998f0-d756-4224-aa29-ab58a8099e85 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:26:27.922493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f45472-affc-4d3c-b0a6-667c0a4cb5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:26:27.923143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45472-affc-4d3c-b0a6-667c0a4cb5ba service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:26:27.923426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45472-affc-4d3c-b0a6-667c0a4cb5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:26:27.923732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45472-affc-4d3c-b0a6-667c0a4cb5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:26:27.933942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f45472-affc-4d3c-b0a6-667c0a4cb5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:26:27.935455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f45472-affc-4d3c-b0a6-667c0a4cb5ba service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:26:27.946122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 725/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:26:37.855500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=20 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:26:37.941429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=23 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:27:01.569460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bacfa-9931-4603-b556-11cd1ffbad7d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:01.570060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bacfa-9931-4603-b556-11cd1ffbad7d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:01.570179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bacfa-9931-4603-b556-11cd1ffbad7d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:01.571549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 746/1471] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:01.576805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d8237-54b1-4bb5-ae68-512aa31dfc61 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:01.577239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d8237-54b1-4bb5-ae68-512aa31dfc61 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:01.577372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d8237-54b1-4bb5-ae68-512aa31dfc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:01.599289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4a6d8237-54b1-4bb5-ae68-512aa31dfc61 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:01.600543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4a6d8237-54b1-4bb5-ae68-512aa31dfc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:01.609972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 726/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:01.668448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3550-016e-490f-9b61-b38d23f2a879 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:01.668740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3550-016e-490f-9b61-b38d23f2a879 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:01.669023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3550-016e-490f-9b61-b38d23f2a879 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:01.670415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 747/1473] 10.222.0.25 () {54 vars in 962 bytes} [Thu May 19 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:01.675235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191b10-3f95-4a21-8ef8-44942eb09114 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:01.675526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191b10-3f95-4a21-8ef8-44942eb09114 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:01.675835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191b10-3f95-4a21-8ef8-44942eb09114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:01.693417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-19191b10-3f95-4a21-8ef8-44942eb09114 None None] MFA Rules not processed for user `e9abdf0cdb63429d926f201034fb72ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:01.694610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-19191b10-3f95-4a21-8ef8-44942eb09114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:01.701007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 727/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Thu May 19 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:27:01.708644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3550-016e-490f-9b61-b38d23f2a879 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:01.719098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3550-016e-490f-9b61-b38d23f2a879 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:01.723227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b90b61-3f0d-4e90-b370-00775bb132cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:01.723890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90b61-3f0d-4e90-b370-00775bb132cc service glance] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:01.724169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90b61-3f0d-4e90-b370-00775bb132cc service glance] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:01.724436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90b61-3f0d-4e90-b370-00775bb132cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:01.733218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b90b61-3f0d-4e90-b370-00775bb132cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:01.734655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b90b61-3f0d-4e90-b370-00775bb132cc service glance] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:01.743910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 748/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:27:04.189849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747d8f-f0f7-43f4-ab86-dc59fd9fcdda None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:04.190387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747d8f-f0f7-43f4-ab86-dc59fd9fcdda None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:04.190387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747d8f-f0f7-43f4-ab86-dc59fd9fcdda None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:04.192313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 728/1476] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:04.197909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75531-49c3-4252-83a1-2e738d8ab05b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:04.198397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75531-49c3-4252-83a1-2e738d8ab05b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:04.198501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75531-49c3-4252-83a1-2e738d8ab05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:04.217046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-eef75531-49c3-4252-83a1-2e738d8ab05b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:04.218256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-eef75531-49c3-4252-83a1-2e738d8ab05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:04.226182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 749/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:04.249359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1747d8f-f0f7-43f4-ab86-dc59fd9fcdda None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:04.262336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1747d8f-f0f7-43f4-ab86-dc59fd9fcdda None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:04.269892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:04.270696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:04.272216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:04.272519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:04.273297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:04.275102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:27:04.275102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:27:04.275102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:27:04.276304 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b8913-9b7d-427c-b0f7-197f6436f3c5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:04.295695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 729/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Thu May 19 16:27:04 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:27:06.562866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc82b90-73c0-45f5-bb07-6b8cceb2e47d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:06.563439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc82b90-73c0-45f5-bb07-6b8cceb2e47d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:06.563439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc82b90-73c0-45f5-bb07-6b8cceb2e47d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:06.564878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 750/1479] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:06.570137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad727d-0034-4177-971e-3c7e32cdc4a9 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:06.570558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad727d-0034-4177-971e-3c7e32cdc4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:06.570702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad727d-0034-4177-971e-3c7e32cdc4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:06.588115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-63ad727d-0034-4177-971e-3c7e32cdc4a9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:06.589305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-63ad727d-0034-4177-971e-3c7e32cdc4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:06.596936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 730/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:06.639404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc82b90-73c0-45f5-bb07-6b8cceb2e47d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:06.654525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc82b90-73c0-45f5-bb07-6b8cceb2e47d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:06.660516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505b8b2-76d8-452b-9722-f63a2de384ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:06.661152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505b8b2-76d8-452b-9722-f63a2de384ff service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:06.661437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505b8b2-76d8-452b-9722-f63a2de384ff service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:06.661715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505b8b2-76d8-452b-9722-f63a2de384ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:06.669942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505b8b2-76d8-452b-9722-f63a2de384ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:06.671541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505b8b2-76d8-452b-9722-f63a2de384ff service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:06.680813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 751/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:27:09.163466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3497eb-7fb0-4d1b-8775-6eb82b1ce3e4 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:09.164226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3497eb-7fb0-4d1b-8775-6eb82b1ce3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:09.164226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3497eb-7fb0-4d1b-8775-6eb82b1ce3e4 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:09.165450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 731/1482] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:09.171310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f947383-13c6-41f8-bfca-e437d030cedc None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:09.172283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f947383-13c6-41f8-bfca-e437d030cedc None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:09.172283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f947383-13c6-41f8-bfca-e437d030cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:09.192431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8f947383-13c6-41f8-bfca-e437d030cedc None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:09.193709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8f947383-13c6-41f8-bfca-e437d030cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:09.201710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 752/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:09.239105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3497eb-7fb0-4d1b-8775-6eb82b1ce3e4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:09.250171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3497eb-7fb0-4d1b-8775-6eb82b1ce3e4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:09.254818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09451c2-843a-4b4e-a477-449b3fd95653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:09.255495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09451c2-843a-4b4e-a477-449b3fd95653 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:09.255831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09451c2-843a-4b4e-a477-449b3fd95653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:09.256112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09451c2-843a-4b4e-a477-449b3fd95653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:09.266127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09451c2-843a-4b4e-a477-449b3fd95653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:09.267582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09451c2-843a-4b4e-a477-449b3fd95653 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:09.279230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 732/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:27:11.598160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51824-d71a-4a46-bb6b-ac455b0f1b61 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:11.598822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51824-d71a-4a46-bb6b-ac455b0f1b61 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:11.598822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51824-d71a-4a46-bb6b-ac455b0f1b61 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:11.600308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 753/1485] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:11.605763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249ddd-030b-4eef-84aa-ed6808aad544 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:11.606234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249ddd-030b-4eef-84aa-ed6808aad544 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:11.606342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249ddd-030b-4eef-84aa-ed6808aad544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:11.624495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ff249ddd-030b-4eef-84aa-ed6808aad544 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:11.625707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ff249ddd-030b-4eef-84aa-ed6808aad544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:11.633611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 733/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:11.671876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51824-d71a-4a46-bb6b-ac455b0f1b61 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:11.683391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51824-d71a-4a46-bb6b-ac455b0f1b61 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:11.686923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ef09-49cc-4a27-8435-fb05c295e921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:11.687564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ef09-49cc-4a27-8435-fb05c295e921 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:11.687877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ef09-49cc-4a27-8435-fb05c295e921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:11.688157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ef09-49cc-4a27-8435-fb05c295e921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:11.697244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ef09-49cc-4a27-8435-fb05c295e921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:11.698706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ef09-49cc-4a27-8435-fb05c295e921 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:11.708548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 754/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:27:14.142117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a792cb6-1dc6-4b58-a062-e3d13f51de14 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:14.142710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a792cb6-1dc6-4b58-a062-e3d13f51de14 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:14.142710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a792cb6-1dc6-4b58-a062-e3d13f51de14 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:14.144633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 734/1488] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:14.150195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a5a28-f6c7-456a-a58a-84c4136eb689 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:14.150641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a5a28-f6c7-456a-a58a-84c4136eb689 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:14.150748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a5a28-f6c7-456a-a58a-84c4136eb689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:14.168845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-301a5a28-f6c7-456a-a58a-84c4136eb689 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:14.170052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-301a5a28-f6c7-456a-a58a-84c4136eb689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:14.177884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 755/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:14.217031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a792cb6-1dc6-4b58-a062-e3d13f51de14 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:14.228136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a792cb6-1dc6-4b58-a062-e3d13f51de14 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:14.231535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3bf65-c61f-4d95-b300-d0317d878fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:14.232191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3bf65-c61f-4d95-b300-d0317d878fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:14.232471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3bf65-c61f-4d95-b300-d0317d878fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:14.232749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3bf65-c61f-4d95-b300-d0317d878fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:14.241428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3bf65-c61f-4d95-b300-d0317d878fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:14.242846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3bf65-c61f-4d95-b300-d0317d878fbe service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:14.251984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 735/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:27:16.746108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397d9da-e902-4204-a492-e6459592214d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:16.746676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397d9da-e902-4204-a492-e6459592214d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:16.746676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397d9da-e902-4204-a492-e6459592214d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:16.748123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 756/1491] 10.222.0.25 () {54 vars in 926 bytes} [Thu May 19 16:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:27:16.753788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dd61b-c994-4cc9-923d-28b0b5f9981b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:16.754216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dd61b-c994-4cc9-923d-28b0b5f9981b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:16.754331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dd61b-c994-4cc9-923d-28b0b5f9981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:16.772647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ec5dd61b-c994-4cc9-923d-28b0b5f9981b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:27:16.773828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ec5dd61b-c994-4cc9-923d-28b0b5f9981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:27:16.781474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 736/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Thu May 19 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:27:16.819171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397d9da-e902-4204-a492-e6459592214d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:27:16.829825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397d9da-e902-4204-a492-e6459592214d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:27:16.833973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb96a8-e08c-4a5f-9349-d610824649cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:27:16.834606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb96a8-e08c-4a5f-9349-d610824649cb service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:27:16.834889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb96a8-e08c-4a5f-9349-d610824649cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:27:16.835170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb96a8-e08c-4a5f-9349-d610824649cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:27:16.844216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb96a8-e08c-4a5f-9349-d610824649cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:27:16.845654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb96a8-e08c-4a5f-9349-d610824649cb service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:27:16.855049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 757/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:27:26.766663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=33 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:27:26.851073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=33 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:29:08.789562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:08.790167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:08.790167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:08.821001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:29:08.823159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:08.837181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 737/1494] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:29:08.846979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:08.847594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:08.847594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:08.868543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:29:08.869867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:08.878546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 758/1495] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:29:08.883554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:08.896379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae31b45-1d9e-462d-947b-80117b67c74c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:08.902649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:08.903369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:08.903739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:08.904071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:08.904928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:29:08.905341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:08.907032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:08.907032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:29:08.907032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:29:08.908235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:08.923075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 738/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:29:08.931811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:08.942115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc79582-6439-46f0-8d57-27da60d683df None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:08.947060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:08.947759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:08.948044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:08.948341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:08.949049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:08.950864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:08.950864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:29:08.950864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:29:08.952146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:08.995587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 759/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:29:08 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:29:09.001244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:09.013285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da2cda-ecb2-481d-85fe-783314225573 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:09.081351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:09.081961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.082263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.082523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.083247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:09.084431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:09.084431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:29:09.084431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:29:09.085741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:09.109186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 739/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:29:09 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:29:09.114612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:09.127659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551cb4c-74e5-4900-963a-1f679831b27e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:09.133242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:09.133964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.134292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.134606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.135416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:09.136557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:09.136557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:29:09.136557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:29:09.137620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:09.152713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 760/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:29:09.158828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:09.169461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932c20-14c5-489e-a92f-c6e353dee4d9 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:09.176221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:09.177146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.177286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.178579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.179357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:09.180376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:09.180376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:29:09.180376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:29:09.181676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74eea3-d7db-4b07-ba61-4c85e05ed90c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:09.197985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 740/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:29:09.202520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:09.212996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287691-bb86-4363-b24f-3e067a343419 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:09.217608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:09.218495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.219312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.219585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] PATH_INFO: `/v3/projects/aa973f6a12064f5796d570192ac8faca/users/565de34ccac24c9299023112ff5168bb/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.236280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa973f6a12064f5796d570192ac8faca, user_id=565de34ccac24c9299023112ff5168bb, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:09.237408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:09.237408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:29:09.237408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:29:09.239713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e35ad-a682-4a40-8c8f-37bd84cf40f2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:09.254647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 761/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:29:09 2022] PUT /identity/v3/projects/aa973f6a12064f5796d570192ac8faca/users/565de34ccac24c9299023112ff5168bb/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:29:09.272290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58a55-4335-4b9f-9b08-1841f57c4492 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.272817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58a55-4335-4b9f-9b08-1841f57c4492 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.273387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58a55-4335-4b9f-9b08-1841f57c4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.320277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-33a58a55-4335-4b9f-9b08-1841f57c4492 None None] MFA Rules not processed for user `565de34ccac24c9299023112ff5168bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:29:09.322373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-33a58a55-4335-4b9f-9b08-1841f57c4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:09.398989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 741/1502] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:29:09.414337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf832ce-4421-44df-afe4-7634b28c35aa None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.414720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf832ce-4421-44df-afe4-7634b28c35aa None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.415049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf832ce-4421-44df-afe4-7634b28c35aa None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.416770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 762/1503] 10.222.0.25 () {54 vars in 963 bytes} [Thu May 19 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:29:09.423207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f0fcb-6511-4308-a5c7-7eb66667a169 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.423486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f0fcb-6511-4308-a5c7-7eb66667a169 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.423814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f0fcb-6511-4308-a5c7-7eb66667a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.442514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-565f0fcb-6511-4308-a5c7-7eb66667a169 None None] MFA Rules not processed for user `e01bb2821eec4234917742be62b441ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:29:09.443767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-565f0fcb-6511-4308-a5c7-7eb66667a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:09.491032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:29:09.501013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 742/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Thu May 19 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:29:09.509073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf832ce-4421-44df-afe4-7634b28c35aa None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:09.520780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf832ce-4421-44df-afe4-7634b28c35aa None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:09.524293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:09.524935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.525217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.525494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.534894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:09.536401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:09.547272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 763/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:29:09.618286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9f8b-ff43-472e-999e-60b3d862d812 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.618698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9f8b-ff43-472e-999e-60b3d862d812 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.619087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9f8b-ff43-472e-999e-60b3d862d812 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.620741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 743/1506] 10.222.0.25 () {52 vars in 829 bytes} [Thu May 19 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:29:09.627693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:09.714414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77510-a383-443a-8d44-1d9710e350f4 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:09.719020 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:09.719939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.720223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.720496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] PATH_INFO: `/v3/users/565de34ccac24c9299023112ff5168bb` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.721973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565de34ccac24c9299023112ff5168bb)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:09.723139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:09.723139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:29:09.723139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:29:09.724832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:09.801367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565de34ccac24c9299023112ff5168bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:09.802304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565de34ccac24c9299023112ff5168bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:09.814756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565de34ccac24c9299023112ff5168bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:09.838573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565de34ccac24c9299023112ff5168bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:09.839448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565de34ccac24c9299023112ff5168bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:09.849042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:29:09.861584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 764/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:29:09 2022] DELETE /identity/v3/users/565de34ccac24c9299023112ff5168bb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:29:09.866878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:09.867795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:09.867795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:09.895436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:29:09.897544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:10.004383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 744/1508] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:29:10.015016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:10.017450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:10.122222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179f2a-d4f7-41ff-8e92-1193cf0130c8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:10.129270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceee103-5a28-401c-8707-e2c1b4385ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:10.130446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee103-5a28-401c-8707-e2c1b4385ede service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:10.130961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee103-5a28-401c-8707-e2c1b4385ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:10.131476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee103-5a28-401c-8707-e2c1b4385ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:10.148602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceee103-5a28-401c-8707-e2c1b4385ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:10.151479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceee103-5a28-401c-8707-e2c1b4385ede service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:10.169949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 765/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:29:10.637890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:29:10.640493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:29:10.665239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245d83-0495-4786-b922-3afc0ee066d9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:29:10.673178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:29:10.674455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:29:10.674785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:29:10.675113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] PATH_INFO: `/v3/projects/aa973f6a12064f5796d570192ac8faca` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:29:10.676535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa973f6a12064f5796d570192ac8faca)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:29:10.677904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:29:10.677904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:29:10.677904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:29:10.679403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:29:10.782471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa973f6a12064f5796d570192ac8faca', 'request_id': 'req-ed067882-1804-4691-9f83-49ee667a96c2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:10.793083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa973f6a12064f5796d570192ac8faca', 'request_id': 'req-ed067882-1804-4691-9f83-49ee667a96c2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:10.819224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa973f6a12064f5796d570192ac8faca', 'request_id': 'req-ed067882-1804-4691-9f83-49ee667a96c2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:10.838339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] The token cache is being invalidate because project aa973f6a12064f5796d570192ac8faca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:29:10.838785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:10.839782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ed067882-1804-4691-9f83-49ee667a96c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:29:10.841973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 745/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:29:10 2022] DELETE /identity/v3/projects/aa973f6a12064f5796d570192ac8faca => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:29:20.161685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=29 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:29:20.834489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:31:01.255934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e6d2c-2015-49a5-a55e-b4b5677e03f6 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:01.256543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e6d2c-2015-49a5-a55e-b4b5677e03f6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:01.256543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e6d2c-2015-49a5-a55e-b4b5677e03f6 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:01.258116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:01.265097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cad94-9386-4c5b-8253-4211be787631 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:01.265624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cad94-9386-4c5b-8253-4211be787631 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:01.266007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cad94-9386-4c5b-8253-4211be787631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:01.289811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-467cad94-9386-4c5b-8253-4211be787631 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:01.291187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-467cad94-9386-4c5b-8253-4211be787631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:01.357790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:01.540168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e6d2c-2015-49a5-a55e-b4b5677e03f6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:01.542613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d76e6d2c-2015-49a5-a55e-b4b5677e03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:01.634540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e6d2c-2015-49a5-a55e-b4b5677e03f6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:01.640211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ceca4-316c-4341-9a1c-3857225b0790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:01.640899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ceca4-316c-4341-9a1c-3857225b0790 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:01.641189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ceca4-316c-4341-9a1c-3857225b0790 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:01.641482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ceca4-316c-4341-9a1c-3857225b0790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:01.651586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ceca4-316c-4341-9a1c-3857225b0790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:01.653284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ceca4-316c-4341-9a1c-3857225b0790 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:01.664351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 767/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:01.925801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977624-5d12-40d7-822f-c1a90e70a4af None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:01.926132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977624-5d12-40d7-822f-c1a90e70a4af None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:01.926395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977624-5d12-40d7-822f-c1a90e70a4af None None] PATH_INFO: `/v3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:01.928286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 747/1514] 10.222.0.57 () {54 vars in 925 bytes} [Thu May 19 16:31:01 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:31:01.935402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f46041-ba39-4e52-9369-f96ae2ca35aa None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:01.935818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f46041-ba39-4e52-9369-f96ae2ca35aa None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:01.936170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f46041-ba39-4e52-9369-f96ae2ca35aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:01.959485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-63f46041-ba39-4e52-9369-f96ae2ca35aa None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:01.961728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-63f46041-ba39-4e52-9369-f96ae2ca35aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:02.033708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 768/1515] 10.222.0.57 () {58 vars in 1015 bytes} [Thu May 19 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:02.588127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a570f-5317-4aff-ae55-1e4ffa278abd None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:02.588660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a570f-5317-4aff-ae55-1e4ffa278abd None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:02.588660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a570f-5317-4aff-ae55-1e4ffa278abd None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:02.590055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:02.596198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c433-0b0f-4a58-b46d-491bb52277e3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:02.596764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c433-0b0f-4a58-b46d-491bb52277e3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:02.596764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c433-0b0f-4a58-b46d-491bb52277e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:02.616347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-aff0c433-0b0f-4a58-b46d-491bb52277e3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:02.617729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-aff0c433-0b0f-4a58-b46d-491bb52277e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:02.626468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:02.784184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a570f-5317-4aff-ae55-1e4ffa278abd None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:02.799318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a570f-5317-4aff-ae55-1e4ffa278abd None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:02.804772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383570-4d0c-4045-b178-211f4bbd3901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:02.805439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383570-4d0c-4045-b178-211f4bbd3901 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:02.805724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383570-4d0c-4045-b178-211f4bbd3901 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:02.806003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383570-4d0c-4045-b178-211f4bbd3901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:02.815075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383570-4d0c-4045-b178-211f4bbd3901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:02.816756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383570-4d0c-4045-b178-211f4bbd3901 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:02.827370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 749/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:05.835290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951706-d259-4bba-b007-f3c723cd618f None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:05.835912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951706-d259-4bba-b007-f3c723cd618f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:05.835912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951706-d259-4bba-b007-f3c723cd618f None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:05.837409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 770/1519] 10.222.0.25 () {54 vars in 960 bytes} [Thu May 19 16:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:05.843879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6080a-5b28-444d-8b39-b499797d6c49 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:05.844436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6080a-5b28-444d-8b39-b499797d6c49 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:05.844436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6080a-5b28-444d-8b39-b499797d6c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:05.866170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-edb6080a-5b28-444d-8b39-b499797d6c49 None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:05.867423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-edb6080a-5b28-444d-8b39-b499797d6c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:05.876301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 750/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Thu May 19 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:05.883954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92951706-d259-4bba-b007-f3c723cd618f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:05.898421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92951706-d259-4bba-b007-f3c723cd618f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:05.903979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b096b2-3880-4bd4-830e-b8f533f42820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:05.904623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b096b2-3880-4bd4-830e-b8f533f42820 service placement] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:05.904910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b096b2-3880-4bd4-830e-b8f533f42820 service placement] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:05.905189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b096b2-3880-4bd4-830e-b8f533f42820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:05.913946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b096b2-3880-4bd4-830e-b8f533f42820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:05.915577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b096b2-3880-4bd4-830e-b8f533f42820 service placement] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:05.927187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 771/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:14.177627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a487d6-0a9c-48a0-9837-1ef6026bb7cc None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:14.178207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a487d6-0a9c-48a0-9837-1ef6026bb7cc None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:14.178207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a487d6-0a9c-48a0-9837-1ef6026bb7cc None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:14.179498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:14.184572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77520fe-7c57-4024-b37e-46c603f9f0ae None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:14.185012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77520fe-7c57-4024-b37e-46c603f9f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:14.185120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77520fe-7c57-4024-b37e-46c603f9f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:14.203343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d77520fe-7c57-4024-b37e-46c603f9f0ae None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:14.204585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d77520fe-7c57-4024-b37e-46c603f9f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:14.212355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:14.364453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a487d6-0a9c-48a0-9837-1ef6026bb7cc None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:14.379177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a487d6-0a9c-48a0-9837-1ef6026bb7cc None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:14.384504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2c753-5d9a-4812-be78-1516107c50dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:14.385144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c753-5d9a-4812-be78-1516107c50dd service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:14.385421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c753-5d9a-4812-be78-1516107c50dd service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:14.385694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c753-5d9a-4812-be78-1516107c50dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:14.394694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2c753-5d9a-4812-be78-1516107c50dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:14.396327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2c753-5d9a-4812-be78-1516107c50dd service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:14.406142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 752/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:15.302488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fdd2a-fcef-4747-bc79-80b5196ab639 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:15.303027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fdd2a-fcef-4747-bc79-80b5196ab639 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:15.303027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fdd2a-fcef-4747-bc79-80b5196ab639 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:15.304401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 16:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:15.309138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2467e8-1f96-430f-a08e-ed14c7173dcc None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:15.309593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2467e8-1f96-430f-a08e-ed14c7173dcc None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:15.309703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2467e8-1f96-430f-a08e-ed14c7173dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:15.327807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ec2467e8-1f96-430f-a08e-ed14c7173dcc None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:15.329059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ec2467e8-1f96-430f-a08e-ed14c7173dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:15.336766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:15.490586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fdd2a-fcef-4747-bc79-80b5196ab639 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:15.507055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fdd2a-fcef-4747-bc79-80b5196ab639 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:15.512908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2822-711d-471d-969e-38b4edb31f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:15.513587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2822-711d-471d-969e-38b4edb31f91 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:15.513874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2822-711d-471d-969e-38b4edb31f91 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:15.514153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2822-711d-471d-969e-38b4edb31f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:15.523925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2822-711d-471d-969e-38b4edb31f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:15.525596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2822-711d-471d-969e-38b4edb31f91 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:15.537116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 774/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:19.697394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86234-ef33-40cf-8617-f09137e05551 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:19.698008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86234-ef33-40cf-8617-f09137e05551 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:19.698008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86234-ef33-40cf-8617-f09137e05551 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:19.699916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:19.705455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933756-931b-4d72-8c54-793a5a392d36 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:19.705969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933756-931b-4d72-8c54-793a5a392d36 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:19.706075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933756-931b-4d72-8c54-793a5a392d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:19.727398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2a933756-931b-4d72-8c54-793a5a392d36 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:19.728678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2a933756-931b-4d72-8c54-793a5a392d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:19.736770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:19.775540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86234-ef33-40cf-8617-f09137e05551 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:19.777303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8fd86234-ef33-40cf-8617-f09137e05551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:19.836673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86234-ef33-40cf-8617-f09137e05551 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:19.840277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d9c3-3662-4bd0-9ed3-44dbd03ff175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:19.840928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d9c3-3662-4bd0-9ed3-44dbd03ff175 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:19.841216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d9c3-3662-4bd0-9ed3-44dbd03ff175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:19.841496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d9c3-3662-4bd0-9ed3-44dbd03ff175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:19.850517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d9c3-3662-4bd0-9ed3-44dbd03ff175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:19.852013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d9c3-3662-4bd0-9ed3-44dbd03ff175 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:19.861294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 755/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:22.097428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e037e-5e8d-4454-9e92-ca3207fed82d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:22.097956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e037e-5e8d-4454-9e92-ca3207fed82d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:22.097956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e037e-5e8d-4454-9e92-ca3207fed82d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:22.099305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:22.104577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587065-99a6-4902-9ea5-8566f6d2e3d5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:22.105041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587065-99a6-4902-9ea5-8566f6d2e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:22.105157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587065-99a6-4902-9ea5-8566f6d2e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:22.123450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1a587065-99a6-4902-9ea5-8566f6d2e3d5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:22.124677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1a587065-99a6-4902-9ea5-8566f6d2e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:22.132586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:22.170283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e037e-5e8d-4454-9e92-ca3207fed82d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:22.183124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e037e-5e8d-4454-9e92-ca3207fed82d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:22.187209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed47b-0a9f-4ef6-8e7d-5e1e17246e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:22.188047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed47b-0a9f-4ef6-8e7d-5e1e17246e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:22.188822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed47b-0a9f-4ef6-8e7d-5e1e17246e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:22.188822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed47b-0a9f-4ef6-8e7d-5e1e17246e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:22.197945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed47b-0a9f-4ef6-8e7d-5e1e17246e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:22.200034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed47b-0a9f-4ef6-8e7d-5e1e17246e10 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:22.209545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 777/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:25.893951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51950c-a147-4520-9cfe-53f85bbda2da None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:25.894705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51950c-a147-4520-9cfe-53f85bbda2da None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:25.894705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51950c-a147-4520-9cfe-53f85bbda2da None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:25.896026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:25.901759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fa31d-d110-4d59-97fa-e0c553bab867 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:25.902700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fa31d-d110-4d59-97fa-e0c553bab867 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:25.902898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fa31d-d110-4d59-97fa-e0c553bab867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:25.921539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-209fa31d-d110-4d59-97fa-e0c553bab867 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:25.922779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-209fa31d-d110-4d59-97fa-e0c553bab867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:25.930638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:26.210908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51950c-a147-4520-9cfe-53f85bbda2da None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:26.212634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7e51950c-a147-4520-9cfe-53f85bbda2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:26.273936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51950c-a147-4520-9cfe-53f85bbda2da None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:26.278152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94165c8-7a5b-49bb-8ea5-a5cc76f8f8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:26.278795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94165c8-7a5b-49bb-8ea5-a5cc76f8f8fc service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:26.279079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94165c8-7a5b-49bb-8ea5-a5cc76f8f8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:26.279354 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94165c8-7a5b-49bb-8ea5-a5cc76f8f8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:26.288119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94165c8-7a5b-49bb-8ea5-a5cc76f8f8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:26.289563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94165c8-7a5b-49bb-8ea5-a5cc76f8f8fc service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:26.294398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:31:26.299728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 758/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:28.613005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02493b-ca41-4f74-907f-6fd20fa73e9c None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:28.613523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02493b-ca41-4f74-907f-6fd20fa73e9c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:28.613523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02493b-ca41-4f74-907f-6fd20fa73e9c None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:28.614878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 16:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:31:28.620583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fa430-af57-46a7-896a-829c6954e1ed None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:28.621655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fa430-af57-46a7-896a-829c6954e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:28.621764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fa430-af57-46a7-896a-829c6954e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:28.640060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-af1fa430-af57-46a7-896a-829c6954e1ed None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:31:28.641270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-af1fa430-af57-46a7-896a-829c6954e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:28.649334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:31:28.918703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02493b-ca41-4f74-907f-6fd20fa73e9c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:31:28.920407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ed02493b-ca41-4f74-907f-6fd20fa73e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:31:28.933387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02493b-ca41-4f74-907f-6fd20fa73e9c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:31:28.936884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2fe94-5f51-4f8f-87ef-47bbb8829e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:31:28.937511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2fe94-5f51-4f8f-87ef-47bbb8829e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:31:28.937786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2fe94-5f51-4f8f-87ef-47bbb8829e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:31:28.938054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2fe94-5f51-4f8f-87ef-47bbb8829e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:31:28.946799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2fe94-5f51-4f8f-87ef-47bbb8829e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:31:28.948269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2fe94-5f51-4f8f-87ef-47bbb8829e19 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:31:28.957527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 780/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:31:38.634672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:31:38.953410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:02.858815 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:02.859465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:02.859465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:02.925008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:02.926341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:02.957990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 760/1540] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:02.972650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:02.973265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:02.973265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.020743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:03.022390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:03.048187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 781/1541] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:03.052851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:03.072428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411429a4-c25b-4b18-a6f5-e6a39674dfd8 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:03.090333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:03.091267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.091559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.091878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.092631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:03.092940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:03.094593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:03.120273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 761/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:03.128293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:03.147902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f546f-07a3-4c14-bc1d-fee65c33b709 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:03.157645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:03.160061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.160608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.161152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.162104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:03.168142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:03.221187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 782/1543] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:03.227201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:03.243211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ddd8b-2d08-48f0-a4e5-49d812d167b4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:03.336380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:03.337270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.337563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.337844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.338552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:03.340783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:03.380553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 762/1544] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:03.386872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:03.402333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6b4c-a2dc-46e2-ac36-f16c481ab155 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:03.409303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:03.410983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.411503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.412026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.413165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:03.415146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:03.433874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 783/1545] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:33:03.440603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:03.465071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278d904-0d05-449b-bdee-0e144d8a324e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:03.476059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68008edb-0188-4f51-be23-d3ffacf814cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:03.477148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008edb-0188-4f51-be23-d3ffacf814cb admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.477719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008edb-0188-4f51-be23-d3ffacf814cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.478209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008edb-0188-4f51-be23-d3ffacf814cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.479559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68008edb-0188-4f51-be23-d3ffacf814cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:03.482986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68008edb-0188-4f51-be23-d3ffacf814cb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:03.510451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 763/1546] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:03.516155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:03.530185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70d7ca-8fd0-4ab3-bf57-13b978d73db5 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:03.539425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b0fc-eb5d-4d18-bcb8-4b9c230b8b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:03.539690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8148-bc25-411d-bf5d-b1bc3e446de2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.539973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8148-bc25-411d-bf5d-b1bc3e446de2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.540474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8148-bc25-411d-bf5d-b1bc3e446de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.541308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b0fc-eb5d-4d18-bcb8-4b9c230b8b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.541815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b0fc-eb5d-4d18-bcb8-4b9c230b8b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.542317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b0fc-eb5d-4d18-bcb8-4b9c230b8b2f admin admin] PATH_INFO: `/v3/projects/6afe2acef4594fe6a4326c001372fdd3/users/9f7bfe07e35d4dc190b099b22d15da7f/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.563883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b0fc-eb5d-4d18-bcb8-4b9c230b8b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afe2acef4594fe6a4326c001372fdd3, user_id=9f7bfe07e35d4dc190b099b22d15da7f, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:03.567784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b0fc-eb5d-4d18-bcb8-4b9c230b8b2f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:03.588727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b56a8148-bc25-411d-bf5d-b1bc3e446de2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:03.590635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b56a8148-bc25-411d-bf5d-b1bc3e446de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:03.594420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 784/1547] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:03 2022] PUT /identity/v3/projects/6afe2acef4594fe6a4326c001372fdd3/users/9f7bfe07e35d4dc190b099b22d15da7f/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:03.609531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32165f91-867a-4fb5-a322-d0ee83f7d4cd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.610167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32165f91-867a-4fb5-a322-d0ee83f7d4cd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.610682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32165f91-867a-4fb5-a322-d0ee83f7d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.647127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-32165f91-867a-4fb5-a322-d0ee83f7d4cd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:03.650810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-32165f91-867a-4fb5-a322-d0ee83f7d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:03.739699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 764/1548] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:03.742215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0396f1-7d64-40ee-8226-b6bc034e448f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.742759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0396f1-7d64-40ee-8226-b6bc034e448f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.743259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0396f1-7d64-40ee-8226-b6bc034e448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.792372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4b0396f1-7d64-40ee-8226-b6bc034e448f None None] MFA Rules not processed for user `9f7bfe07e35d4dc190b099b22d15da7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:03.794297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4b0396f1-7d64-40ee-8226-b6bc034e448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:03.838786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 785/1549] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:03.841168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6f2f-3a93-44eb-a663-14d14b957b5f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.841637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6f2f-3a93-44eb-a663-14d14b957b5f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.842087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6f2f-3a93-44eb-a663-14d14b957b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.886794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:03.908941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-aeed6f2f-3a93-44eb-a663-14d14b957b5f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:03.910475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-aeed6f2f-3a93-44eb-a663-14d14b957b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:03.927241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 786/1550] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:03.927443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 765/1551] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:03.929389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c966f-730f-4768-b9e0-180da33af255 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.929623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3621-6811-4e14-b71f-7a4ab1b2b36f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.930169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3621-6811-4e14-b71f-7a4ab1b2b36f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.930300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c966f-730f-4768-b9e0-180da33af255 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.930654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3621-6811-4e14-b71f-7a4ab1b2b36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.931045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c966f-730f-4768-b9e0-180da33af255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.953603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7d4c966f-730f-4768-b9e0-180da33af255 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:03.955854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7d4c966f-730f-4768-b9e0-180da33af255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:03.966483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 787/1552] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:03.969173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69aa2-5e38-497c-a123-da4a850f6899 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:03.969691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69aa2-5e38-497c-a123-da4a850f6899 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:03.970199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69aa2-5e38-497c-a123-da4a850f6899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:03.997242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-bcd69aa2-5e38-497c-a123-da4a850f6899 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.001357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-bcd69aa2-5e38-497c-a123-da4a850f6899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.005676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-70cd3621-6811-4e14-b71f-7a4ab1b2b36f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.013091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 788/1553] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.013666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-70cd3621-6811-4e14-b71f-7a4ab1b2b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.018468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae4f99-eb91-4a63-8ecb-108a3d0162e2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.018984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae4f99-eb91-4a63-8ecb-108a3d0162e2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.021924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae4f99-eb91-4a63-8ecb-108a3d0162e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.044799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1bae4f99-eb91-4a63-8ecb-108a3d0162e2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.046878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1bae4f99-eb91-4a63-8ecb-108a3d0162e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.057566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 789/1554] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.059642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.060269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.060821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.078253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 766/1555] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.083827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1914b1-6eeb-4edc-a732-270cfd376807 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.090711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1914b1-6eeb-4edc-a732-270cfd376807 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.091535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1914b1-6eeb-4edc-a732-270cfd376807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.113820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.116665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.126581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-cb1914b1-6eeb-4edc-a732-270cfd376807 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.128691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cb1914b1-6eeb-4edc-a732-270cfd376807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.130172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 790/1556] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.131565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.144190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 767/1557] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.145953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e77ac9-e09b-46d0-bc91-c9217dc2035e None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.146313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e77ac9-e09b-46d0-bc91-c9217dc2035e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.146798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e77ac9-e09b-46d0-bc91-c9217dc2035e None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.148376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 768/1558] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 19 16:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:04.149706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1baed-a5e7-4ab7-9c87-499ee9b70501 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.150049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1baed-a5e7-4ab7-9c87-499ee9b70501 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.150395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1baed-a5e7-4ab7-9c87-499ee9b70501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.154353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c5e79-e8d7-40cb-a2a7-2cc7041ddd68 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.161327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.162090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.162411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.162728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.163562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.164001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.165366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:33:04.165366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:33:04.165366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:33:04.166828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.172704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f3e1baed-a5e7-4ab7-9c87-499ee9b70501 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.173930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f3e1baed-a5e7-4ab7-9c87-499ee9b70501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.181660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 791/1559] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.182517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.182920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 769/1560] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.184198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7001-c819-42ae-989c-3331752d86e4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.184488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7001-c819-42ae-989c-3331752d86e4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.184770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7001-c819-42ae-989c-3331752d86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.196392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce860ff-12c2-4b99-b1e8-7dacdae6828c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.201632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.202268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.202549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.202822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.203544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.203880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.204242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-907a7001-c819-42ae-989c-3331752d86e4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.205438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-907a7001-c819-42ae-989c-3331752d86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.205553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.213552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 770/1561] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.214645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.214936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.215214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.219600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 792/1562] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.220779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.230829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75fb3-e2f7-4f5f-b5ce-e085b775d17e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.235342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.235485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.236161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.236446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.236640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.236755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.237441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.237749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.239371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8903c72-3381-491b-9180-bd97acaf2101 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.245685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 771/1563] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.246788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.254695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 793/1564] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.255927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22865f7-a953-4a5f-9635-8d42df265bf1 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.256215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22865f7-a953-4a5f-9635-8d42df265bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.256586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22865f7-a953-4a5f-9635-8d42df265bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.257877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfadf5-e078-4d1e-9436-394544642682 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.263484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.264472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.264764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.266298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.267073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.267420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.269102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.276951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e22865f7-a953-4a5f-9635-8d42df265bf1 None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.278151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e22865f7-a953-4a5f-9635-8d42df265bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.281691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 772/1565] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.282507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.292265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75bc40-3e36-4600-88c1-6100b2a4c46b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.296910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.297562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.297851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.298133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.298818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.299886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:33:04.299886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:33:04.299886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:33:04.301082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.304211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:04.331859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 773/1566] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.332699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.357655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 794/1567] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.359047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281dfe-dc39-4624-930b-fc0a687d2dae None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.359334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281dfe-dc39-4624-930b-fc0a687d2dae None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.359651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281dfe-dc39-4624-930b-fc0a687d2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.378089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-88281dfe-dc39-4624-930b-fc0a687d2dae None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.379292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-88281dfe-dc39-4624-930b-fc0a687d2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.398103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc85c1-ea0d-41c4-a407-d3fd984b1c88 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.402965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.403658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.403951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.404234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.404964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.405280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.406917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.419512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 774/1568] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.420569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.432131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9731d-a01d-4c61-9fca-da26919f2233 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.436782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.437439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.437720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.438002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.438680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.440622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.441536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 795/1569] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.442906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.443201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.443489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.461673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:04.462893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:04.472204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 796/1570] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:04.473261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.482367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 775/1571] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.482367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.487009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87911c0-ffcb-4dd0-b362-f5dc12c5e280 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.538475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:04.552411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6218dc-dec3-4248-b292-a1c6d77537bf admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.559691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.560412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.560701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.561000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.561706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.563706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.570830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.572133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.572621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.573087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.574301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.577799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.590336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 776/1572] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.591188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.611950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 797/1573] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.611950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.673535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:04.676976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55593-4a8e-4090-a81c-1730862afcd6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.706959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f8b3-8517-4935-9e59-cfb2ee1d9b7a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.713454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.714578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.715050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.715321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.737327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.738009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.738290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.738599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.739318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.741315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.763336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 777/1574] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.764055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.774341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90410058-bc66-46f7-bc8e-50ece04927c7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.778153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.779642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.779902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.780300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.780582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.780855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.781526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.783427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.789097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 798/1575] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:04.790451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.802695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7981-f624-40e7-b682-50ddd692a65a service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.807698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.808380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.808757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.809052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.810152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.810387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.812323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.821818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 778/1576] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.823196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.827871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 799/1577] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.827871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.836735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8710e-839e-447a-95b4-4b12000fa4bb admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.889105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:04.906986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4a776-8573-4e32-9352-35154d4007c8 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.918743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.919869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.920349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.920840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.921918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:04.922340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.929640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.935847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.936726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.937021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.937306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.938177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.939236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:33:04.939236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:33:04.939236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:33:04.940547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.949452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 779/1578] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:04.949452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.964324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 800/1579] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:04.965087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:04.968533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e30f4-a946-49e6-b516-cbe987eee53d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.976416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425f72-3ec8-4d33-ac08-6266af7f8dbe admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:04.978049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.979182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.979724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.980219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.981509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.982375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:04.983118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:04.983412 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:04.983740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:04.984429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:04.985281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:04.986670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.011129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 801/1580] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.012652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.021888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 780/1581] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:04 2022] POST /identity/v3/users => generated 296 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.023086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.025730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293470e2-2b7d-443a-af45-1c5cabb6c39c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.032981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.033662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.033949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.034223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.034958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.035714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fccc1f-330c-4cd8-aac2-f137f1df9550 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.036629 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.040431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.041038 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.041384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.041593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.042278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.044243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.048294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 802/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.049100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.064602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a332-19b7-4d14-8f06-a38951e78fb8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.066706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 781/1583] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/users => generated 284 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.067535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.074822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.075506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.075810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.076118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.076816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.078639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452f4a-7a8e-4b58-a6a4-c527dd87d276 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.078778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.083265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.083954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.084236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.084511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.085229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.087199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.099885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:05.113841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 803/1584] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.113841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.119655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 782/1585] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.119655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.188888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f9617-6ce0-4551-8f01-1e69d7815e5e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.190171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d5baf-6eea-4812-be59-eba276869d18 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.193974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74245878-cffc-4c41-a6e0-0de1f5fcca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.194172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.194816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74245878-cffc-4c41-a6e0-0de1f5fcca56 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.194926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.195106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74245878-cffc-4c41-a6e0-0de1f5fcca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.195203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.195415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74245878-cffc-4c41-a6e0-0de1f5fcca56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.195570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.196191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74245878-cffc-4c41-a6e0-0de1f5fcca56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.196312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.197842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74245878-cffc-4c41-a6e0-0de1f5fcca56 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.197958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.208580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 783/1586] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.208935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 804/1587] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.209442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.210276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67001-f705-44ae-80cb-46715fd16680 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.210501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67001-f705-44ae-80cb-46715fd16680 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.210784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67001-f705-44ae-80cb-46715fd16680 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.214682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 805/1588] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 19 16:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:05.214682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec67001-f705-44ae-80cb-46715fd16680 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.224028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55743bda-586a-4643-ab74-1fc5c3a9aca6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.227348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec67001-f705-44ae-80cb-46715fd16680 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.229660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.230332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.230614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.230884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.231606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.231914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.232578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.232860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.233136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.233313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.233867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.235495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.245975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 784/1589] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.246971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.250068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 806/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.251013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.257327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a09daf-f0e3-4272-8c52-4b6072d9f3ee admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.261645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8d56-a274-4cfd-a881-1431abbdeca2 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.263995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.264767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.265054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.265337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.266329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.267313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.268407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.268805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.268909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.268909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.269871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.271198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.283422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 785/1591] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.283422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.291194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e699-0313-4b76-b61e-a3e9517c94cd admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.295119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 807/1592] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.296061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.296551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.296833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.297087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.297369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.298080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.300102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.312091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77844-42f8-47a2-a766-68a5057bb671 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.318219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0642a-911f-4947-a15b-a66befa01012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.318975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0642a-911f-4947-a15b-a66befa01012 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.319400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0642a-911f-4947-a15b-a66befa01012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.319838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0642a-911f-4947-a15b-a66befa01012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.320888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0642a-911f-4947-a15b-a66befa01012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.322642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 786/1593] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:05.322865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0642a-911f-4947-a15b-a66befa01012 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.323439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.335375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 808/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.337326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.337929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.338223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.342645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec3b14-2d3b-43e8-9e6f-1829ce2b2ffa admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.348573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.349260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.349566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.349831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.350614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.352888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.363377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:05.364664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:05.365190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 787/1595] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.366044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.379121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167b296-b8c8-435e-95fe-8585207790cc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.384150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.385129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.385129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.385367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.388187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.388187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.399311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 788/1596] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.400324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.410531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00835244-e47e-46dc-bfe3-ed1c07cd25b2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.415790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.416685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.416970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.417246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] PATH_INFO: `/v3/projects/2496809a708a4ec6a27e898cb50d781f/users/24e949ad734a4688938fc19cfdc93396/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.433758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2496809a708a4ec6a27e898cb50d781f, user_id=24e949ad734a4688938fc19cfdc93396, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.435152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:33:05.435152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:33:05.435152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:33:05.436798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.448979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:05.455912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 789/1597] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:05 2022] PUT /identity/v3/projects/2496809a708a4ec6a27e898cb50d781f/users/24e949ad734a4688938fc19cfdc93396/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:05.455912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.464871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 809/1598] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:05.465839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.477508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79629e79-c481-4906-adb9-6e5fe7346659 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.525218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:05.536040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ec03-2356-4850-8efd-b7ed8e12d9ed admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.541455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.542115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.542402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.542677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.543419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.544055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.544738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.545022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.545169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.545325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.546007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.547700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.558992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 790/1599] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.558992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.563015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 810/1600] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.563983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.566824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18c78-9afb-4c3b-aaee-cf9837308a78 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.571812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.572488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.572887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.573063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.573770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.574922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f1d6-e3ee-422c-9911-e76c202241aa admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.575380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.579727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.580703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.580901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.581175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] PATH_INFO: `/v3/projects/c99e87b957b546a48999ad8bf7607ee9/users/19f70bd63f13461682c0667097409361/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.587517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 791/1601] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:05.588387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.597626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99e87b957b546a48999ad8bf7607ee9, user_id=19f70bd63f13461682c0667097409361, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.598674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f602c-a014-4e7a-9bf7-fa03e85d489b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.600349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.604054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c025958-29a3-44b1-aaf8-6ced56699d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.604957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c025958-29a3-44b1-aaf8-6ced56699d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.605239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c025958-29a3-44b1-aaf8-6ced56699d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.605515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c025958-29a3-44b1-aaf8-6ced56699d41 admin admin] PATH_INFO: `/v3/projects/6bd9939f0a8646499455779efe463b4a/users/74f6d398a8434677b9a60c3754be083d/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.616715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 811/1602] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:05 2022] PUT /identity/v3/projects/c99e87b957b546a48999ad8bf7607ee9/users/19f70bd63f13461682c0667097409361/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:05.617745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.622030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c025958-29a3-44b1-aaf8-6ced56699d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd9939f0a8646499455779efe463b4a, user_id=74f6d398a8434677b9a60c3754be083d, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.624746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c025958-29a3-44b1-aaf8-6ced56699d41 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.638909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 792/1603] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:05 2022] PUT /identity/v3/projects/6bd9939f0a8646499455779efe463b4a/users/74f6d398a8434677b9a60c3754be083d/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:05.640219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.640868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.641376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.680117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] MFA Rules not processed for user `24e949ad734a4688938fc19cfdc93396`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:05.681375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:05.700142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f787b-ec48-4b07-896b-d6410378e2be admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.760705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 793/1604] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:05.761732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.762211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.763181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.763468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.763789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] PATH_INFO: `/v3/projects/4837ab5df3a14b9a85336de11a337989/users/a3099b72043c41ce8daa9bf8457efde3/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.780665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4837ab5df3a14b9a85336de11a337989, user_id=a3099b72043c41ce8daa9bf8457efde3, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.783422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.798977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 812/1605] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:05 2022] PUT /identity/v3/projects/4837ab5df3a14b9a85336de11a337989/users/a3099b72043c41ce8daa9bf8457efde3/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:05.799745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.822436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100075e-c02d-4aac-afc0-caa66d8988df None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.826190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:05.854475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:05.870832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac0b08-bcd0-476a-8e1a-56d20f0fe3b3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.875569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.876144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:05.876483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.876763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.876884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:05.877035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] PATH_INFO: `/v3/projects/3ee781473dc643a48f4d98cfac55ec67/users/7bec03735bd4448287479bbce0ddc5d6/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.877151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:05.877346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:05.894696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee781473dc643a48f4d98cfac55ec67, user_id=7bec03735bd4448287479bbce0ddc5d6, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.898273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.912947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 813/1606] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:05 2022] PUT /identity/v3/projects/3ee781473dc643a48f4d98cfac55ec67/users/7bec03735bd4448287479bbce0ddc5d6/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:05.914753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.953571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:05.955217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:05.966767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 794/1607] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:05.967634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:05.980003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589356c6-ef72-4cc0-8685-a4fa63074353 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:05.997321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804725-d62a-458b-b1c0-e6b8b950fa67 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.011167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f39f4-0a15-4873-a330-c060c11f2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.012317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f39f4-0a15-4873-a330-c060c11f2ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.012794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f39f4-0a15-4873-a330-c060c11f2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.013276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f39f4-0a15-4873-a330-c060c11f2ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.014591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f39f4-0a15-4873-a330-c060c11f2ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.017891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f39f4-0a15-4873-a330-c060c11f2ccd admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.031284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 814/1608] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:06.032679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ac31-aa7c-4902-a9a7-19a5191f6362 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.032972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ac31-aa7c-4902-a9a7-19a5191f6362 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.033256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ac31-aa7c-4902-a9a7-19a5191f6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.048488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b4dba-7c75-499c-bcf2-1906d0d712f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.049238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b4dba-7c75-499c-bcf2-1906d0d712f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.049458 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b4dba-7c75-499c-bcf2-1906d0d712f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.049740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b4dba-7c75-499c-bcf2-1906d0d712f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.050483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b4dba-7c75-499c-bcf2-1906d0d712f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.057084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b4dba-7c75-499c-bcf2-1906d0d712f4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.072466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3780ac31-aa7c-4902-a9a7-19a5191f6362 None None] MFA Rules not processed for user `19f70bd63f13461682c0667097409361`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:06.072808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 795/1609] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:06.072976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3780ac31-aa7c-4902-a9a7-19a5191f6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.073140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.073140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.073140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.101289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:06.103141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.112329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 796/1610] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:06.117175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.129755 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecbe67-7c2c-4856-afd3-a98a658dfa3f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.135794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da2e1-e5a5-4c5d-a792-6be41e90773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.136495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da2e1-e5a5-4c5d-a792-6be41e90773a admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.136786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da2e1-e5a5-4c5d-a792-6be41e90773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.137058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da2e1-e5a5-4c5d-a792-6be41e90773a admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.137779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da2e1-e5a5-4c5d-a792-6be41e90773a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.139832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da2e1-e5a5-4c5d-a792-6be41e90773a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.173159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 797/1611] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:06.174575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.175042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 815/1612] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:06.175820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.176393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.176686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.176907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.177034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.200710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:06.203274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.210212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] MFA Rules not processed for user `7bec03735bd4448287479bbce0ddc5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:06.212014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.216097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:06.264037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:06.282979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 798/1613] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:06.283963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.295341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48519-ca0d-4dfe-88d5-9055f13d75c0 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.300016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 816/1614] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:06.300016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.300273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.300940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.301380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.301667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] PATH_INFO: `/v3/projects/0e00da4e34fb4ef1a51c483cf7b9784d/users/227442421824437b9f02876e95406720/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.309779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad65f7-cb6e-4517-95df-2fe4f66dc243 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.316250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.317128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.317456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.317575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e00da4e34fb4ef1a51c483cf7b9784d, user_id=227442421824437b9f02876e95406720, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.317673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] PATH_INFO: `/v3/projects/18d0a2572b3e4ac09422ff4a4f831277/users/4df5c2b1e22f4c54b05eb77d9ba9818b/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.320311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.335721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d0a2572b3e4ac09422ff4a4f831277, user_id=4df5c2b1e22f4c54b05eb77d9ba9818b, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.338125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 799/1615] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:06 2022] PUT /identity/v3/projects/0e00da4e34fb4ef1a51c483cf7b9784d/users/227442421824437b9f02876e95406720/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:06.338125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.339048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.357384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 817/1616] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:06 2022] PUT /identity/v3/projects/18d0a2572b3e4ac09422ff4a4f831277/users/4df5c2b1e22f4c54b05eb77d9ba9818b/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:06.358262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.431842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b2fc-07f3-4ad4-b1e9-b136505f94de admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.458065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5a24-6c3f-4ef3-aec4-30ee80df941a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.467072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.469230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.469715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.470206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.471492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.475180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.502530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 818/1617] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:06.503741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.506576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.507289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.507584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.507984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.519219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.520728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.532554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 800/1618] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:06.545259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.556819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f947d02-7e36-48d6-946e-4ba3fe4f050e service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.563044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.563931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.564318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.564706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.579691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.581522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.586807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857c4ad-bbe2-4d8f-90db-95deb00ef4ae admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.591000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912183d-3b4e-42b2-b63b-68e75fa8889f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.591679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912183d-3b4e-42b2-b63b-68e75fa8889f service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.591974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912183d-3b4e-42b2-b63b-68e75fa8889f service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.592250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912183d-3b4e-42b2-b63b-68e75fa8889f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.594877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 801/1619] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:06.595830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.615261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53158a66-0a3c-4fc0-b8b4-b6134cb13bdc service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.621348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ce8d5-18be-4578-b2ea-ee4f3c8415c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.622021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce8d5-18be-4578-b2ea-ee4f3c8415c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.622308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce8d5-18be-4578-b2ea-ee4f3c8415c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.622594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce8d5-18be-4578-b2ea-ee4f3c8415c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.623452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ce8d5-18be-4578-b2ea-ee4f3c8415c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.625378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ce8d5-18be-4578-b2ea-ee4f3c8415c0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.674019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 802/1620] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:06.676345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.677111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.677513 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.691645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912183d-3b4e-42b2-b63b-68e75fa8889f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.693792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912183d-3b4e-42b2-b63b-68e75fa8889f service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.707300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 819/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:06.708955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.709438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.709795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.712924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] MFA Rules not processed for user `227442421824437b9f02876e95406720`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:06.714188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.719220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:06.742750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:06.757101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:06.762942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.809433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 803/1622] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:06.810426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.886674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 820/1623] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:06.890874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.920078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c97961-fa14-4617-8b04-fff7ab2efb44 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.930429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.936005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.936568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.937124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.940291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.944863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.956308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7014-0345-4ba4-8537-28e2a63d17e2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:06.964716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:06.965658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:06.965985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:06.966321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:06.967748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:06.970104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:06.983658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 821/1624] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:06.984316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 804/1625] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:06.985140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.985424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:06.987442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:06.998291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c36b2-0449-4488-b314-078474b56802 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.005579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.006462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.006877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.007394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.009808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.014082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.076764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 822/1626] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:06 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:07.077983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.103537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a057e80-786a-4451-a221-46eb41ef7626 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.179137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.180564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.180851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.181171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.193806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:07.206943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740eeb-8ac4-4cfe-9106-138c23c26fbe admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.214452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.215167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.215473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.215768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.216651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.218280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.232772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 823/1627] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:07.233684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.247264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bda33-d6cc-4007-bef2-bdd63983d2bb admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.252145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177e15-ac00-40f3-910e-3bd12cc8b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.253057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177e15-ac00-40f3-910e-3bd12cc8b24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.253351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177e15-ac00-40f3-910e-3bd12cc8b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.253622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177e15-ac00-40f3-910e-3bd12cc8b24f admin admin] PATH_INFO: `/v3/projects/e1621dac9f0e4ebc9f1c18b242fb54a4/users/03a0f75231d04ea19a2c65617a480ba2/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.275156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177e15-ac00-40f3-910e-3bd12cc8b24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1621dac9f0e4ebc9f1c18b242fb54a4, user_id=03a0f75231d04ea19a2c65617a480ba2, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.278823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.279852 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177e15-ac00-40f3-910e-3bd12cc8b24f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.281035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.297827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 805/1628] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:07.299148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.300054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 824/1629] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:07 2022] PUT /identity/v3/projects/e1621dac9f0e4ebc9f1c18b242fb54a4/users/03a0f75231d04ea19a2c65617a480ba2/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:07.302898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0086c-dcff-433c-9a19-610bf0cc7559 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.303452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0086c-dcff-433c-9a19-610bf0cc7559 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.304011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0086c-dcff-433c-9a19-610bf0cc7559 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.307161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 825/1630] 10.222.0.25 () {54 vars in 961 bytes} [Thu May 19 16:33:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:07.308899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0086c-dcff-433c-9a19-610bf0cc7559 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.315737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616345c-0c8b-4f5a-bb06-8cb7fae8fe86 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.376599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:07.404267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0086c-dcff-433c-9a19-610bf0cc7559 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.411665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.412929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.413355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.413773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] PATH_INFO: `/v3/projects/59cf7a87baca4c6aaf6539060498ab07/users/0da0546e8dcd4a8b988d31b1d86c4c4e/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.435130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cf7a87baca4c6aaf6539060498ab07, user_id=0da0546e8dcd4a8b988d31b1d86c4c4e, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.438743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.448032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca5ac-ec20-4828-a882-6e48cf6d50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.449030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca5ac-ec20-4828-a882-6e48cf6d50df admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.449422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca5ac-ec20-4828-a882-6e48cf6d50df admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.449773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca5ac-ec20-4828-a882-6e48cf6d50df admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.451816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ca5ac-ec20-4828-a882-6e48cf6d50df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.460692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ca5ac-ec20-4828-a882-6e48cf6d50df admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.467265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 826/1631] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:07 2022] PUT /identity/v3/projects/59cf7a87baca4c6aaf6539060498ab07/users/0da0546e8dcd4a8b988d31b1d86c4c4e/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:07.469307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.510450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 806/1632] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:07 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:07.511906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.514920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.515275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.551632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:07.553704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:07.667133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411e65-c3a0-4274-9c7a-39a896663290 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.678007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.679550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.682490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.684118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.684995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.688242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.724014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 807/1633] 10.222.0.25 () {58 vars in 1058 bytes} [Thu May 19 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:07.724014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.741668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 827/1634] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:07.743453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.745642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c48ec-d60c-43cf-b039-5d822c9f2844 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.761472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.762274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.762634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.762982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.764967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.767016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.777030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c340fb-eb8a-4823-8c67-e08c2f7233ed admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.780281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 808/1635] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:07.784893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.801776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc83a5-273b-4c41-8633-f961b1263a74 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.807413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac85eab-d59a-4ac2-8f8f-d15a6d2dc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.808719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85eab-d59a-4ac2-8f8f-d15a6d2dc8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.809197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85eab-d59a-4ac2-8f8f-d15a6d2dc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.809581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85eab-d59a-4ac2-8f8f-d15a6d2dc8ec admin admin] PATH_INFO: `/v3/projects/e1621dac9f0e4ebc9f1c18b242fb54a4/users/03a0f75231d04ea19a2c65617a480ba2/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.810175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4636f0e-79fc-43bd-bcdd-b5b9e0e79b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.811026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4636f0e-79fc-43bd-bcdd-b5b9e0e79b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.811673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4636f0e-79fc-43bd-bcdd-b5b9e0e79b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.812097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4636f0e-79fc-43bd-bcdd-b5b9e0e79b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.812719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85eab-d59a-4ac2-8f8f-d15a6d2dc8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1621dac9f0e4ebc9f1c18b242fb54a4, user_id=03a0f75231d04ea19a2c65617a480ba2, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.813188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4636f0e-79fc-43bd-bcdd-b5b9e0e79b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:07.814962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4636f0e-79fc-43bd-bcdd-b5b9e0e79b9d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.815804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85eab-d59a-4ac2-8f8f-d15a6d2dc8ec admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:07.842677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 809/1636] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:07 2022] PUT /identity/v3/projects/e1621dac9f0e4ebc9f1c18b242fb54a4/users/03a0f75231d04ea19a2c65617a480ba2/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:07.842677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547143b-6c2a-4349-a546-5e8baa7e6403 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.842677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547143b-6c2a-4349-a546-5e8baa7e6403 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.842677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547143b-6c2a-4349-a546-5e8baa7e6403 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.842677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 810/1637] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 19 16:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:07.842677 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547143b-6c2a-4349-a546-5e8baa7e6403 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:07.847454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 828/1638] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:07.849173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.852259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.852259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.858787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:07.932547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] MFA Rules not processed for user `03a0f75231d04ea19a2c65617a480ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:07.933787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:07.987337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547143b-6c2a-4349-a546-5e8baa7e6403 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:07.994266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59d4f4-02e7-43b2-ae2f-49e0d93c80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:07.995189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d4f4-02e7-43b2-ae2f-49e0d93c80b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:07.995526 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d4f4-02e7-43b2-ae2f-49e0d93c80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:07.996023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d4f4-02e7-43b2-ae2f-49e0d93c80b8 admin admin] PATH_INFO: `/v3/projects/59cf7a87baca4c6aaf6539060498ab07/users/0da0546e8dcd4a8b988d31b1d86c4c4e/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:07.998201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59d4f4-02e7-43b2-ae2f-49e0d93c80b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cf7a87baca4c6aaf6539060498ab07, user_id=0da0546e8dcd4a8b988d31b1d86c4c4e, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.002322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59d4f4-02e7-43b2-ae2f-49e0d93c80b8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:08.018059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 811/1639] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:07 2022] PUT /identity/v3/projects/59cf7a87baca4c6aaf6539060498ab07/users/0da0546e8dcd4a8b988d31b1d86c4c4e/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:08.020380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689799e2-bcba-472a-9411-a3860c2c556b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.020719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689799e2-bcba-472a-9411-a3860c2c556b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.021166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689799e2-bcba-472a-9411-a3860c2c556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.067116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 829/1640] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:08.067116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:08.076381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685efa0-e4ff-4ee5-b508-3b78f0019bb0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:08.077982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-689799e2-bcba-472a-9411-a3860c2c556b None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:08.079166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-689799e2-bcba-472a-9411-a3860c2c556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:08.127175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:08.182099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:08.183684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.184382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.185093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] PATH_INFO: `/v3/projects/c50931e94a10469bbdee693fadde43d2/users/2ab0f012a41b40e18d8d27f47124e1bb/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.192272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 812/1641] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:08.193918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.194276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.194625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.233669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50931e94a10469bbdee693fadde43d2, user_id=2ab0f012a41b40e18d8d27f47124e1bb, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.238019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:08.248833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] MFA Rules not processed for user `0da0546e8dcd4a8b988d31b1d86c4c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:08.250650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:08.270276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 830/1642] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:08 2022] PUT /identity/v3/projects/c50931e94a10469bbdee693fadde43d2/users/2ab0f012a41b40e18d8d27f47124e1bb/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:08.271284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:08.388177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737addad-95d6-485a-8a3e-6a28dc9fac60 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:08.398956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:08.399752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.401066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.401445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.408211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 813/1643] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:08.409175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:08.448194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:08.523193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650171e1-741b-4f59-8c43-4c3035197621 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:08.530624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826775a-1a42-4fe9-9b40-b5cfdacb5c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:08.531532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826775a-1a42-4fe9-9b40-b5cfdacb5c9e service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.532026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826775a-1a42-4fe9-9b40-b5cfdacb5c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.533301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826775a-1a42-4fe9-9b40-b5cfdacb5c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.552753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.554232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:08.574705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 831/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:08.575716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:08.677029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826775a-1a42-4fe9-9b40-b5cfdacb5c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.679040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826775a-1a42-4fe9-9b40-b5cfdacb5c9e service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:08.685794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edccb81-4000-4de5-9af1-1f255b36ff7c service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:08.692277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:08.693226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.693672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.694111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.695207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.698540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:08.727834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 814/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:08.736003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d54569-9c57-4db7-b056-126bd0a7d299 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.736203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 832/1646] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:08.736331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d54569-9c57-4db7-b056-126bd0a7d299 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.736573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d54569-9c57-4db7-b056-126bd0a7d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.737336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:08.748179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:08.767278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2dd8-ec02-4c49-b3dc-8194460f2533 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:08.774779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:08.775867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.776395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.776774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.801028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d7d54569-9c57-4db7-b056-126bd0a7d299 None None] MFA Rules not processed for user `74f6d398a8434677b9a60c3754be083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:08.803014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d7d54569-9c57-4db7-b056-126bd0a7d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:08.892365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.894036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:08.917156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 833/1647] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:08.923608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:08.949075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386e7b6-861e-40e8-937b-c43cd32192eb service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:08.957764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 815/1648] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:08.962694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff98c9-4fdc-4e10-a121-d3b652b70e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:08.963411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff98c9-4fdc-4e10-a121-d3b652b70e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.963822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff98c9-4fdc-4e10-a121-d3b652b70e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.964296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff98c9-4fdc-4e10-a121-d3b652b70e4a admin admin] PATH_INFO: `/v3/projects/c50931e94a10469bbdee693fadde43d2/users/2ab0f012a41b40e18d8d27f47124e1bb/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.968556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff98c9-4fdc-4e10-a121-d3b652b70e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50931e94a10469bbdee693fadde43d2, user_id=2ab0f012a41b40e18d8d27f47124e1bb, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:08.970732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:08.971191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:08.971817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:08.972907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff98c9-4fdc-4e10-a121-d3b652b70e4a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:09.020729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 834/1649] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:08 2022] PUT /identity/v3/projects/c50931e94a10469bbdee693fadde43d2/users/2ab0f012a41b40e18d8d27f47124e1bb/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:09.022581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:09.022970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:09.023349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:09.040772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] MFA Rules not processed for user `74f6d398a8434677b9a60c3754be083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:09.042060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:09.086526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] MFA Rules not processed for user `2ab0f012a41b40e18d8d27f47124e1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:09.087996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:09.144713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:09.168573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 816/1650] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:09.168573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:09.168894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 835/1651] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:09.168894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:09.234007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2471-f7bf-4123-9850-5b0ceaaa98fa None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:09.238596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:09.239253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:09.239771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:09.240058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:09.262210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386c79-78cb-4a31-b188-adbf34d158a3 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:09.272198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:09.276236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:09.276698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:09.277156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:09.293127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:09.375500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:09.378183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:09.416144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 836/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:09.425042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:09.427908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:09.445727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 817/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:09.721752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:09.834936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:09.848534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdf86c-2024-4ba5-aab5-6096e32bed69 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:09.858408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:09.859314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:09.859746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:09.860056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:09.886663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:09.888580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:09.918509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 818/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:33:09.920260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d483c0-c145-48fb-b841-e29e415f0268 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:09.933514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:09.934293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:09.934753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:09.937236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:09.957868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:09.964657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:10.000509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 837/1655] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:10.099082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:10.269716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f7a9-2598-4bd3-b4df-16674d265fb5 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:10.296233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:10.297386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:10.297724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:10.298191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] PATH_INFO: `/v3/users/9f7bfe07e35d4dc190b099b22d15da7f` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:10.299760 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7bfe07e35d4dc190b099b22d15da7f)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:10.301921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: WARNING py.warnings [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:33:10.301921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: warnings.warn(msg) May 19 16:33:10.301921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: May 19 16:33:10.303853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:10.439725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:10.490210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7bfe07e35d4dc190b099b22d15da7f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:10.493286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7bfe07e35d4dc190b099b22d15da7f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:10.513221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7bfe07e35d4dc190b099b22d15da7f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:10.559122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:10.572508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32f47-2573-4a81-af95-39f73a2cf73f service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:10.582443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:10.584719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:10.585164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:10.586272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:10.597379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7bfe07e35d4dc190b099b22d15da7f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:10.638867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-688249c7-292b-48b2-94ce-7fdff02e4d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7bfe07e35d4dc190b099b22d15da7f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:10.670798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 819/1656] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:10 2022] DELETE /identity/v3/users/9f7bfe07e35d4dc190b099b22d15da7f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:10.672878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6821-6130-4540-b350-a886f99475ab None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:10.673178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6821-6130-4540-b350-a886f99475ab None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:10.673463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6821-6130-4540-b350-a886f99475ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:10.732158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:10.733661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:10.754282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 838/1657] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:10.756487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a62a6821-6130-4540-b350-a886f99475ab None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:10.757847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a62a6821-6130-4540-b350-a886f99475ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:11.266916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 820/1658] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 595 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:11.323898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:11.413222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559245-4e08-459e-9dc5-ecbc9282e476 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:11.413597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559245-4e08-459e-9dc5-ecbc9282e476 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:11.413937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559245-4e08-459e-9dc5-ecbc9282e476 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:11.416396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 821/1659] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 19 16:33:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:33:11.424166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:11.425691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:11.425972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:11.490411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:11.504385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47dcc-0d3d-4d0f-9ad9-3bd8ee88db13 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:11.549412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] MFA Rules not processed for user `6ae2e3c1b1b04ce7950a81c33308d560`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:11.550930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:11.643670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:11.644997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:11.645454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:11.646222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:11.661060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:11.662938 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:11.677363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 839/1660] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:11.719831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 822/1661] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:11.769885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:11.771869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:11.792731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfef31-3f63-4a47-85fb-c8e3ca00e170 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:11.804673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e6305-8ff5-4b92-8442-88811bb757ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:11.805481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6305-8ff5-4b92-8442-88811bb757ac service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:11.807320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6305-8ff5-4b92-8442-88811bb757ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:11.807628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6305-8ff5-4b92-8442-88811bb757ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:11.858231 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e6305-8ff5-4b92-8442-88811bb757ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:11.859764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e6305-8ff5-4b92-8442-88811bb757ac service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:11.876071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 840/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:12.707496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:12.709285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:12.745349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef329bf-5261-49e2-86f7-e2125467f3b7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:12.772355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:12.773955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:12.774231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:12.774676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] PATH_INFO: `/v3/projects/6afe2acef4594fe6a4326c001372fdd3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:12.779644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afe2acef4594fe6a4326c001372fdd3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:12.787030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:12.916175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:12.925909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afe2acef4594fe6a4326c001372fdd3', 'request_id': 'req-8a0223f4-f603-41d5-910b-93a267bc7b12'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:12.943892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afe2acef4594fe6a4326c001372fdd3', 'request_id': 'req-8a0223f4-f603-41d5-910b-93a267bc7b12'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:12.960278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afe2acef4594fe6a4326c001372fdd3', 'request_id': 'req-8a0223f4-f603-41d5-910b-93a267bc7b12'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:12.998336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] The token cache is being invalidate because project 6afe2acef4594fe6a4326c001372fdd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:12.998336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:13.000599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8a0223f4-f603-41d5-910b-93a267bc7b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:13.011174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 823/1663] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:12 2022] DELETE /identity/v3/projects/6afe2acef4594fe6a4326c001372fdd3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:13.012377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4b94-8d0e-41a7-b855-be18c3cabb80 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.013170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4b94-8d0e-41a7-b855-be18c3cabb80 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.013688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4b94-8d0e-41a7-b855-be18c3cabb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.020282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ef048-2bd5-4e6c-b3e2-14c3eed662a0 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.020673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ef048-2bd5-4e6c-b3e2-14c3eed662a0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.021046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ef048-2bd5-4e6c-b3e2-14c3eed662a0 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.022703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 824/1664] 10.222.0.25 () {54 vars in 960 bytes} [Thu May 19 16:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:33:13.035400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.035753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.038787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.043323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f48f4b94-8d0e-41a7-b855-be18c3cabb80 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:13.044893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f48f4b94-8d0e-41a7-b855-be18c3cabb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:13.095144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] MFA Rules not processed for user `0610a73cbaf54e21a63a0469ceb9c856`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:13.097265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:13.223478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 841/1665] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:13.231696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.231993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.232276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.271633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:13.272893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:13.289797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 825/1666] 10.222.0.25 () {58 vars in 1057 bytes} [Thu May 19 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:13.295736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.299475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 842/1667] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:13.304082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.308537 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242382c5-85fe-49d4-a187-1483d8e5bd9d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.316241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.317059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.317187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b7e3e-62a6-4b60-8f30-106b022eee52 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.317434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.317618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.319525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:13.323746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.324778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.325060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.325427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.326703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:13.327126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.329149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:13.355064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 843/1668] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:33:13.359257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.376767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.378873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:13.382324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355573a-ee48-4713-a0d1-1957b7c3b8cf admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.397846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.398694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.398972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.401541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.404685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 826/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:33:13.418250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.420380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:13.475492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 844/1670] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:13 2022] POST /identity/v3/projects => generated 403 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:33:13.476367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.504509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60279-6f19-439e-b967-c98831339208 service placement] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.689571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.690664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.691049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.691427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.692377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.713722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:13.744801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 827/1671] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:13 2022] POST /identity/v3/users => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:33:13.748780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.788478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fc6e-a6b3-4079-a6c5-d34b8f616915 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.801752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.802448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.802735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.803169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.804313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.806633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:13.851091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 845/1672] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:13.855935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.867690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078ae5e-7bee-4b8e-a6be-f09147cc0bca admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.874005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768865-283f-4d96-a9d7-b09c00deea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.875578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768865-283f-4d96-a9d7-b09c00deea79 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.875578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768865-283f-4d96-a9d7-b09c00deea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.875578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768865-283f-4d96-a9d7-b09c00deea79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.876907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34768865-283f-4d96-a9d7-b09c00deea79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.878728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34768865-283f-4d96-a9d7-b09c00deea79 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:13.910949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 828/1673] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:33:13.911657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:13.935307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06318b7-edad-4974-a60c-f81633c4fe67 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:13.943771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:13.944688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:13.944968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:13.945998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] PATH_INFO: `/v3/projects/c891bba09967410a97877d98543b9fc4/users/9afb10fcc08e46d0acd9121726421510/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:13.971327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c891bba09967410a97877d98543b9fc4, user_id=9afb10fcc08e46d0acd9121726421510, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:13.976668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:14.005886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6fb43-fe47-4b55-8c0f-0b983a404108 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:14.005886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6fb43-fe47-4b55-8c0f-0b983a404108 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:14.005886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6fb43-fe47-4b55-8c0f-0b983a404108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:14.009433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 846/1674] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:13 2022] PUT /identity/v3/projects/c891bba09967410a97877d98543b9fc4/users/9afb10fcc08e46d0acd9121726421510/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:14.037993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8df6fb43-fe47-4b55-8c0f-0b983a404108 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:14.039278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8df6fb43-fe47-4b55-8c0f-0b983a404108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:14.105143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:14.158183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 829/1675] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:14.170071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:14.176371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:14.263965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:14.442041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e75400-93cc-4436-a960-53688d595baf admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:14.452827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:14.453621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:14.453779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:14.454530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:14.472449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:14.474118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:14.505689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 847/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:16.346039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:16.346445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:16.354427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:16.418636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] MFA Rules not processed for user `9afb10fcc08e46d0acd9121726421510`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:16.422370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:16.731424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 830/1677] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:16.735527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:16.763123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53793e7-f45d-4185-b547-d1ec2de3fa1c service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:16.785989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:16.787046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:16.787899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:16.788338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:16.790903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:16.797963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:16.837244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:16.839268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:16.877763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588fafe-05fd-44ec-a2d5-7a8c31580f85 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:16.914457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:16.918425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:16.923092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:16.924402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] PATH_INFO: `/v3/users/7bec03735bd4448287479bbce0ddc5d6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:16.928271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 848/1678] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:16 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:16.929217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bec03735bd4448287479bbce0ddc5d6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:16.931043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:16.934789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:17.102206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bec03735bd4448287479bbce0ddc5d6'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:17.104746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bec03735bd4448287479bbce0ddc5d6'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:17.120098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bec03735bd4448287479bbce0ddc5d6'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:17.151158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bec03735bd4448287479bbce0ddc5d6'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:17.154091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f790a-e71f-4bf2-9f95-7e92b93b4419 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:17.166113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:17.166872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f23abc9-79da-481a-8cfd-8930cb32747a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bec03735bd4448287479bbce0ddc5d6'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:17.167506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:17.167815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:17.168094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:17.170114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:17.175882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:17.180861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 831/1679] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:16 2022] DELETE /identity/v3/users/7bec03735bd4448287479bbce0ddc5d6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:17.186629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:17.186985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:17.187252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:17.223069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 849/1680] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:16 2022] POST /identity/v3/users => generated 309 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:17.224407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:17.227791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:17.232153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:17.233342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:17.258895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc3a0-76c5-4912-9f91-87fcc1071a0b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:17.315135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:17.426857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 832/1681] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:17.440728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:17.441609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:17.441929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:17.442209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:17.443091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:17.446705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:17.480826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 850/1682] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:33:17.484513 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:17.502656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90896c9-e45e-4849-a031-dc5b469e28f6 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:17.519993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844a64b-1935-4ea4-80b7-4401bf08d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:17.535970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a64b-1935-4ea4-80b7-4401bf08d631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:17.537388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a64b-1935-4ea4-80b7-4401bf08d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:17.537745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a64b-1935-4ea4-80b7-4401bf08d631 admin admin] PATH_INFO: `/v3/projects/58f45a726153495fb7177c712af4d6cd/users/06bb0bf1981b4b858fc4aea0d9e96123/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:17.616674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a64b-1935-4ea4-80b7-4401bf08d631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f45a726153495fb7177c712af4d6cd, user_id=06bb0bf1981b4b858fc4aea0d9e96123, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:17.631566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a64b-1935-4ea4-80b7-4401bf08d631 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:17.696566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 833/1683] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:17 2022] PUT /identity/v3/projects/58f45a726153495fb7177c712af4d6cd/users/06bb0bf1981b4b858fc4aea0d9e96123/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:17.703266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:17.741294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b4900-b151-4b96-8b62-9257fa2f09b2 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:17.753147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:17.753633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:17.754050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:17.810785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:17.816430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:17.845664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:17.995082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:17.995269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:17.995531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:17.995811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:17.996501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:17.998148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:18.029718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 851/1684] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:18.036493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:18.040583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:18.044722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 834/1685] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 19 16:33:18.047671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:18.108769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd80b48-4fda-4875-b89c-4f8eaca01208 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:18.137804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:18.138779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:18.139337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:18.139768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] PATH_INFO: `/v3/projects/58f45a726153495fb7177c712af4d6cd/users/06bb0bf1981b4b858fc4aea0d9e96123/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:18.156150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f45a726153495fb7177c712af4d6cd, user_id=06bb0bf1981b4b858fc4aea0d9e96123, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:18.165773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:18.196288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9de7fd-d7cf-4ad9-8f0a-7858b5429311 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:18.199969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 835/1686] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:18 2022] PUT /identity/v3/projects/58f45a726153495fb7177c712af4d6cd/users/06bb0bf1981b4b858fc4aea0d9e96123/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:18.315835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:18.317274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:18.317566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:18.317848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:18.383142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:18.385205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:18.498452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:18.501141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:18.528191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 852/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:18.698609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc04b13-849b-4c94-b1f6-d64c7d8cce4b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:18.717047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a70a19-0abd-4b4a-aad1-49fd6e7bf185 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:18.717735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a70a19-0abd-4b4a-aad1-49fd6e7bf185 service swift] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:18.718401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a70a19-0abd-4b4a-aad1-49fd6e7bf185 service swift] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:18.718888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a70a19-0abd-4b4a-aad1-49fd6e7bf185 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:18.849609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:18.892871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a70a19-0abd-4b4a-aad1-49fd6e7bf185 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:18.901432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a70a19-0abd-4b4a-aad1-49fd6e7bf185 service swift] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:18.946193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 836/1688] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 16:33:19.408645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:19.413133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:19.437397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ff45b-3ca1-451a-bba2-78aeafc59d1b service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:19.443582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:19.444948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:19.445381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:19.445803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] PATH_INFO: `/v3/users/24e949ad734a4688938fc19cfdc93396` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:19.447653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e949ad734a4688938fc19cfdc93396)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:19.450236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:19.483293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:19.562445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e949ad734a4688938fc19cfdc93396'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:19.565597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e949ad734a4688938fc19cfdc93396'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:19.590371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e949ad734a4688938fc19cfdc93396'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:19.643486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e949ad734a4688938fc19cfdc93396'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:19.645110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e949ad734a4688938fc19cfdc93396'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:19.707853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 853/1689] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:19 2022] DELETE /identity/v3/users/24e949ad734a4688938fc19cfdc93396 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:19.713768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:19.715202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:19.716144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:19.756334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:19.758909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:19.930770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 837/1690] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:19.971896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:19.973730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:20.150209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446c91-b3e0-4852-b6ff-409450033c46 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:20.162481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d3b3e-7b0d-47dc-b402-237e39591854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:20.163219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3b3e-7b0d-47dc-b402-237e39591854 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:20.163511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3b3e-7b0d-47dc-b402-237e39591854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:20.164426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3b3e-7b0d-47dc-b402-237e39591854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:20.188000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3b3e-7b0d-47dc-b402-237e39591854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:20.195100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3b3e-7b0d-47dc-b402-237e39591854 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:20.231378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 854/1691] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:20.760674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:20.762889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:20.796219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa3841-af69-4c71-b847-9f235e50fa75 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:20.829098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:20.832032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:20.832936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:20.834869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] PATH_INFO: `/v3/users/227442421824437b9f02876e95406720` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:20.860280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] RBAC: Authorizing `identity:delete_user(user_id=227442421824437b9f02876e95406720)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:20.870254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:21.028292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227442421824437b9f02876e95406720'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.029129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227442421824437b9f02876e95406720'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.051400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227442421824437b9f02876e95406720'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.080802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227442421824437b9f02876e95406720'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.090411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227442421824437b9f02876e95406720'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.098960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 838/1692] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:20 2022] DELETE /identity/v3/users/227442421824437b9f02876e95406720 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:21.103833 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cb988-40d6-4a26-82aa-d129bfc9d6a8 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:21.104407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cb988-40d6-4a26-82aa-d129bfc9d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:21.104671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cb988-40d6-4a26-82aa-d129bfc9d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:21.139404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9e0cb988-40d6-4a26-82aa-d129bfc9d6a8 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:21.141816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9e0cb988-40d6-4a26-82aa-d129bfc9d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:21.247856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:21.249751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:21.387682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 855/1693] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:21.396380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:21.396674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:21.397026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:21.426594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:21.435135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f309a-0011-4133-8633-0679b225617c admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:21.449674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:21.451717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:21.452291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:21.452798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] PATH_INFO: `/v3/users/19f70bd63f13461682c0667097409361` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:21.456777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f70bd63f13461682c0667097409361)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:21.461586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:21.467219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] MFA Rules not processed for user `6ae2e3c1b1b04ce7950a81c33308d560`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:21.468882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:21.567344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f70bd63f13461682c0667097409361'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.568128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f70bd63f13461682c0667097409361'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.581581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f70bd63f13461682c0667097409361'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.602195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:21.609154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f70bd63f13461682c0667097409361'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.637914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f70bd63f13461682c0667097409361'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:21.651430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 839/1694] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:21 2022] DELETE /identity/v3/users/19f70bd63f13461682c0667097409361 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:21.653410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:21.656551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:21.667386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 856/1695] 10.222.0.57 () {58 vars in 1015 bytes} [Thu May 19 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:21.668467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:21.684768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:21.720014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3cb3-3b3b-44fa-a8b8-bfa6e6bb0154 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:21.891730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:21.893018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:21.893595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:21.894171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:21.894799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa222d-17bc-4eb4-bffb-4e3098f93dd1 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:21.897495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:21.908469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:21.910149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:21.910149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:21.911125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] PATH_INFO: `/v3/projects/3ee781473dc643a48f4d98cfac55ec67` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:21.918337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee781473dc643a48f4d98cfac55ec67)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:21.923119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:21.924083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:21.925864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6f35-a46b-4906-9154-a58ef0fc6b69 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:21.956010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 857/1696] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:21.959301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:21.963033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:21.963646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.056671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:22.060784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:22.089930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee781473dc643a48f4d98cfac55ec67', 'request_id': 'req-3090e1ed-3bdb-45d7-8347-a7676d99d398'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.119410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee781473dc643a48f4d98cfac55ec67', 'request_id': 'req-3090e1ed-3bdb-45d7-8347-a7676d99d398'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.141261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee781473dc643a48f4d98cfac55ec67', 'request_id': 'req-3090e1ed-3bdb-45d7-8347-a7676d99d398'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.174515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] The token cache is being invalidate because project 3ee781473dc643a48f4d98cfac55ec67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:22.174821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.177569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3090e1ed-3bdb-45d7-8347-a7676d99d398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.180471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 840/1697] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:21 2022] DELETE /identity/v3/projects/3ee781473dc643a48f4d98cfac55ec67 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:22.185997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:22.186299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:22.186573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.221200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:22.255990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 858/1698] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:22.259978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:22.261698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:22.269335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] MFA Rules not processed for user `4df5c2b1e22f4c54b05eb77d9ba9818b`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:22.270588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:22.489094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 841/1699] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:22.490658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:22.494036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:22.550909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be5f0d-2a43-464e-a761-27d64265e7a9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:22.552234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15383b5-c165-4f4c-aeb5-c62deeb1c68f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:22.574624 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:22.575241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:22.576181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:22.576470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:22.576748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] PATH_INFO: `/v3/users/0da0546e8dcd4a8b988d31b1d86c4c4e` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.578140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:22.583116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:22.583778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.585217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da0546e8dcd4a8b988d31b1d86c4c4e)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:22.592853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:22.607028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:22.643026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:22.646524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:22.670151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 859/1700] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:22.672054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:22.730689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e26ae-24e0-4e90-ad8c-c5e8972891ae service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:22.737557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da0546e8dcd4a8b988d31b1d86c4c4e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.738269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da0546e8dcd4a8b988d31b1d86c4c4e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.754421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da0546e8dcd4a8b988d31b1d86c4c4e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.758300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe04106-53b9-405a-aa9e-1db4cc923a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:22.760813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe04106-53b9-405a-aa9e-1db4cc923a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:22.762363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe04106-53b9-405a-aa9e-1db4cc923a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:22.764129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe04106-53b9-405a-aa9e-1db4cc923a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.787485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da0546e8dcd4a8b988d31b1d86c4c4e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.801593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe04106-53b9-405a-aa9e-1db4cc923a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:22.818973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-588ce562-302e-4a0c-863d-22ae8a950782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da0546e8dcd4a8b988d31b1d86c4c4e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:22.820897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe04106-53b9-405a-aa9e-1db4cc923a6f service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:22.849822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 842/1701] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:22 2022] DELETE /identity/v3/users/0da0546e8dcd4a8b988d31b1d86c4c4e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:22.854049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:22.859769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:22.860177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.890879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 860/1702] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:22.902253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:22.902837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:22.903902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:22.979840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] MFA Rules not processed for user `06bb0bf1981b4b858fc4aea0d9e96123`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:22.983013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.033666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] MFA Rules not processed for user `a3099b72043c41ce8daa9bf8457efde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:23.042782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.097126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:23.165030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:23.190935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 843/1703] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:23.198770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:23.200915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.293946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 861/1704] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:23.295222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:23.301093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.509647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59c08-80fe-4b06-b0a4-2dc3499bbd9a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:23.524470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae906-5370-4b14-aee7-10e08c43a80b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:23.531304 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:23.534561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:23.535259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:23.536692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:23.538074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:23.539509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:23.539808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:23.540089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] PATH_INFO: `/v3/projects/2496809a708a4ec6a27e898cb50d781f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:23.541326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2496809a708a4ec6a27e898cb50d781f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:23.542371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: WARNING py.warnings [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 16:33:23.542371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: warnings.warn(msg) May 19 16:33:23.542371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: May 19 16:33:23.543609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:23.546534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.712315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2496809a708a4ec6a27e898cb50d781f', 'request_id': 'req-57d18113-df0d-436f-8888-7890ed0b4076'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:23.731828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2496809a708a4ec6a27e898cb50d781f', 'request_id': 'req-57d18113-df0d-436f-8888-7890ed0b4076'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:23.733467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:23.738165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:23.763400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2496809a708a4ec6a27e898cb50d781f', 'request_id': 'req-57d18113-df0d-436f-8888-7890ed0b4076'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:23.786950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 844/1705] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:23.789558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:23.792888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.805651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] The token cache is being invalidate because project 2496809a708a4ec6a27e898cb50d781f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:23.805987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:23.812028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-57d18113-df0d-436f-8888-7890ed0b4076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:23.821085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 862/1706] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:23 2022] DELETE /identity/v3/projects/2496809a708a4ec6a27e898cb50d781f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:23.824323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b301f4-6779-4e0a-a5d6-365c87c13f13 service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:23.829153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:23.829447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:23.829708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:23.898468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] MFA Rules not processed for user `a3099b72043c41ce8daa9bf8457efde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:23.899878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:23.989902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:23.993446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:23.993836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:23.993950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] PATH_INFO: `/v3/projects/0e00da4e34fb4ef1a51c483cf7b9784d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:23.996516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e00da4e34fb4ef1a51c483cf7b9784d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:24.002259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:24.004293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:24.050853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 863/1707] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:24.060722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:24.073227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:24.088859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:24.115006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e00da4e34fb4ef1a51c483cf7b9784d', 'request_id': 'req-353f1463-263e-47ad-a92d-86e1adc28b70'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.128360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fd08-b02d-4ed2-8b48-b6009786f8f3 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:24.129478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e00da4e34fb4ef1a51c483cf7b9784d', 'request_id': 'req-353f1463-263e-47ad-a92d-86e1adc28b70'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.140661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e00da4e34fb4ef1a51c483cf7b9784d', 'request_id': 'req-353f1463-263e-47ad-a92d-86e1adc28b70'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.161612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] The token cache is being invalidate because project 0e00da4e34fb4ef1a51c483cf7b9784d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:24.162032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.163082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.166037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 845/1708] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:23 2022] DELETE /identity/v3/projects/0e00da4e34fb4ef1a51c483cf7b9784d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:24.167313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:24.168806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:24.310972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:24.313110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:24.313664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:24.314206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] PATH_INFO: `/v3/users/03a0f75231d04ea19a2c65617a480ba2` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:24.316009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a0f75231d04ea19a2c65617a480ba2)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:24.319346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:24.332889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f1463-263e-47ad-a92d-86e1adc28b70 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:24.354745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:24.355651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:24.355932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:24.357466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:24.360210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:24.458253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a0f75231d04ea19a2c65617a480ba2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.459862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a0f75231d04ea19a2c65617a480ba2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.472414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a0f75231d04ea19a2c65617a480ba2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.508477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a0f75231d04ea19a2c65617a480ba2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.511907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a0f75231d04ea19a2c65617a480ba2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:24.548848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 864/1709] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:24 2022] DELETE /identity/v3/users/03a0f75231d04ea19a2c65617a480ba2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:24.549890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:24.555815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:24.627507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:24.629473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:24.664809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 846/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:24.854028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637d2a8-9926-4121-8814-97682c97d8f7 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:24.888610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:24.895506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:24.898860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:24.902531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] PATH_INFO: `/v3/users/2ab0f012a41b40e18d8d27f47124e1bb` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:24.909041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab0f012a41b40e18d8d27f47124e1bb)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:24.916376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:24.932930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:25.122505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab0f012a41b40e18d8d27f47124e1bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:25.125113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab0f012a41b40e18d8d27f47124e1bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:25.160714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab0f012a41b40e18d8d27f47124e1bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:25.220040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab0f012a41b40e18d8d27f47124e1bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:25.222026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8fb29df2-ace3-438c-948d-40bfdf6f4283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab0f012a41b40e18d8d27f47124e1bb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:25.298534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 865/1711] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:24 2022] DELETE /identity/v3/users/2ab0f012a41b40e18d8d27f47124e1bb => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:25.990367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:25.992454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:26.019523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e4c0-33a6-4617-9f9f-8017ffacbcf2 service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:26.146509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:26.160466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:26.161692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:26.162058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:26.162442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] PATH_INFO: `/v3/projects/c99e87b957b546a48999ad8bf7607ee9` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:26.167210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99e87b957b546a48999ad8bf7607ee9)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:26.169516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:26.277077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99e87b957b546a48999ad8bf7607ee9', 'request_id': 'req-9c3af609-9ef8-44ee-9142-8b850d4802b2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.293018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99e87b957b546a48999ad8bf7607ee9', 'request_id': 'req-9c3af609-9ef8-44ee-9142-8b850d4802b2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.308408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99e87b957b546a48999ad8bf7607ee9', 'request_id': 'req-9c3af609-9ef8-44ee-9142-8b850d4802b2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.328152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] The token cache is being invalidate because project c99e87b957b546a48999ad8bf7607ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:26.328489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.329310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.333234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 847/1712] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:25 2022] DELETE /identity/v3/projects/c99e87b957b546a48999ad8bf7607ee9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:26.339366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6d20-ee8b-4a08-a937-fdc44e7be526 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:26.339883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6d20-ee8b-4a08-a937-fdc44e7be526 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:26.340109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6d20-ee8b-4a08-a937-fdc44e7be526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:26.384677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9d1c6d20-ee8b-4a08-a937-fdc44e7be526 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:26.384797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:26.386214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:26.391201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9d1c6d20-ee8b-4a08-a937-fdc44e7be526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:26.632573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3af609-9ef8-44ee-9142-8b850d4802b2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:26.646307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:26.652273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:26.653044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:26.653615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] PATH_INFO: `/v3/projects/59cf7a87baca4c6aaf6539060498ab07` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:26.655822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cf7a87baca4c6aaf6539060498ab07)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:26.658695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:26.791468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cf7a87baca4c6aaf6539060498ab07', 'request_id': 'req-f0c02919-7bf7-4824-a2f2-c8cf05207804'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.799937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cf7a87baca4c6aaf6539060498ab07', 'request_id': 'req-f0c02919-7bf7-4824-a2f2-c8cf05207804'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.824095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cf7a87baca4c6aaf6539060498ab07', 'request_id': 'req-f0c02919-7bf7-4824-a2f2-c8cf05207804'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.862485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] The token cache is being invalidate because project 59cf7a87baca4c6aaf6539060498ab07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:26.864137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.865032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-f0c02919-7bf7-4824-a2f2-c8cf05207804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:26.872408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 848/1713] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:26 2022] DELETE /identity/v3/projects/59cf7a87baca4c6aaf6539060498ab07 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:26.877736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fbf2e-1c42-4bd3-9c38-283d08e8f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:26.878193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fbf2e-1c42-4bd3-9c38-283d08e8f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:26.883997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fbf2e-1c42-4bd3-9c38-283d08e8f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:26.931417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e60fbf2e-1c42-4bd3-9c38-283d08e8f3d5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:26.932998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e60fbf2e-1c42-4bd3-9c38-283d08e8f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:26.974339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:27.000080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 866/1714] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 654 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:27.016669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.016956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.017246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.053637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:27.054982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:27.124059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 849/1715] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:27.132719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.133038 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.135004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.178988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:27.187698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:27.202696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 850/1716] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:27.212333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.234495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 867/1717] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:27.236517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338017-5cbb-4fc7-847c-305a5473291c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.238426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.251301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.253444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719e2cf-b8cb-4778-ae45-32b9202d46e2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.254061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.254409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.254770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.257022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:27.260644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.262434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.264507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.265485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.265783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.266067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.267824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:27.268153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.269850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.302908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 868/1718] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:27.307579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.312035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 851/1719] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:27.313036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.331440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e057-cd6f-4f59-9d35-8cd6f5c50e86 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.336644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4ba8-3e0c-4182-b6bc-3a5cd8f61592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.337337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4ba8-3e0c-4182-b6bc-3a5cd8f61592 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.337623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4ba8-3e0c-4182-b6bc-3a5cd8f61592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.337905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4ba8-3e0c-4182-b6bc-3a5cd8f61592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.338643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4ba8-3e0c-4182-b6bc-3a5cd8f61592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.340808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4ba8-3e0c-4182-b6bc-3a5cd8f61592 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.341492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a6b6-89c2-4036-a163-30dca3ba315b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.355154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.356129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.356496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.356774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.357930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:27.358476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.362991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.397848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 869/1720] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:27.399980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94046a-3ca5-42ee-aa2f-4b310d0eafed None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.400572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94046a-3ca5-42ee-aa2f-4b310d0eafed None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.400987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94046a-3ca5-42ee-aa2f-4b310d0eafed None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.402600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 870/1721] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:27.403537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94046a-3ca5-42ee-aa2f-4b310d0eafed None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.435840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 852/1722] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:27.441840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.543351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94046a-3ca5-42ee-aa2f-4b310d0eafed None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.587498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537f14d-e232-40f9-8fe5-31019abae7d5 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.601563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.602330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.602657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.602999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.603859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.605903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.658225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 853/1723] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/users => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:33:27.658452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.683022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c56f8-d00e-4640-8428-f372979a4c82 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.696326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b1bab-6109-408b-bcd7-055e13762117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.697283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b1bab-6109-408b-bcd7-055e13762117 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.699958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b1bab-6109-408b-bcd7-055e13762117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.700366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b1bab-6109-408b-bcd7-055e13762117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.701393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b1bab-6109-408b-bcd7-055e13762117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.705332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.705739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b1bab-6109-408b-bcd7-055e13762117 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.707209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.708223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.709038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.711233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.716223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.740132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 854/1724] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:27.746956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.747327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.748734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.758528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 871/1725] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/users => generated 291 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:27.759773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.774037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55411-35e9-4161-bb9d-f20fe70a4121 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.780073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.781237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.781727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.782205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.783155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.786696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.797348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:27.801198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:27.832319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 872/1726] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:27.833613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.879300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b531-ec6c-4910-863d-0388471c3f65 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.888806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.890243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.895650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.896581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.898712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:27.902766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:27.925452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 873/1727] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:27.926488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.938024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:27.954462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da8e2-cf94-4760-b459-6e40ff2429da admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:27.964253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30189-589f-4864-8071-bf181e2fd2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:27.965914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30189-589f-4864-8071-bf181e2fd2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:27.966535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30189-589f-4864-8071-bf181e2fd2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:27.966842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30189-589f-4864-8071-bf181e2fd2e0 admin admin] PATH_INFO: `/v3/projects/8c77b4620f4542ab8c9f7d8b3af6c524/users/3f20134aacfc4abc8017b894d4f1b436/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:27.983144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 855/1728] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:27.984098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:27.999743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e30189-589f-4864-8071-bf181e2fd2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c77b4620f4542ab8c9f7d8b3af6c524, user_id=3f20134aacfc4abc8017b894d4f1b436, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:28.002505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e30189-589f-4864-8071-bf181e2fd2e0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:28.008882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1511fd-f432-4a94-b9db-9012689316a1 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:28.024016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:28.024903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.025209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.026460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.029129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:28.039427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:28.043659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 874/1729] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:27 2022] PUT /identity/v3/projects/8c77b4620f4542ab8c9f7d8b3af6c524/users/3f20134aacfc4abc8017b894d4f1b436/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:28.054585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.054951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.055356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.072198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 856/1730] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:28.073772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:28.100182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d982-11d8-4a42-8684-69d2bb755c44 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:28.144987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] MFA Rules not processed for user `3f20134aacfc4abc8017b894d4f1b436`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:28.151285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:28.240093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:28.350263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f506-31a5-4b6f-95f5-f6274a989361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:28.352535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f506-31a5-4b6f-95f5-f6274a989361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.352826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f506-31a5-4b6f-95f5-f6274a989361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.353112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f506-31a5-4b6f-95f5-f6274a989361 admin admin] PATH_INFO: `/v3/projects/033a4f29bf784b42a6b9373d7b301a0b/users/27d9771e0eee461b80e0ea9c464dadb3/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.402096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f506-31a5-4b6f-95f5-f6274a989361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033a4f29bf784b42a6b9373d7b301a0b, user_id=27d9771e0eee461b80e0ea9c464dadb3, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:28.403663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 875/1731] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:28.408473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:28.409077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f506-31a5-4b6f-95f5-f6274a989361 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:28.411824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:28.445140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97895c-1200-4e69-ba35-9a28b1008612 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:28.452516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 857/1732] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:28 2022] PUT /identity/v3/projects/033a4f29bf784b42a6b9373d7b301a0b/users/27d9771e0eee461b80e0ea9c464dadb3/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:28.454988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c10af-c975-469b-92e7-480ad8624e49 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.456517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c10af-c975-469b-92e7-480ad8624e49 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.457688 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c10af-c975-469b-92e7-480ad8624e49 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.463400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 858/1733] 10.222.0.25 () {54 vars in 912 bytes} [Thu May 19 16:33:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:28.470102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c10af-c975-469b-92e7-480ad8624e49 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:28.591442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:28.602506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.602794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.603037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] PATH_INFO: `/v3/projects/e1621dac9f0e4ebc9f1c18b242fb54a4` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.610907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1621dac9f0e4ebc9f1c18b242fb54a4)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:28.617288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:28.708917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c10af-c975-469b-92e7-480ad8624e49 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:28.715847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e31be-bee2-47aa-8e57-f987f147fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:28.728733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e31be-bee2-47aa-8e57-f987f147fa47 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.730319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e31be-bee2-47aa-8e57-f987f147fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.731018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e31be-bee2-47aa-8e57-f987f147fa47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.731999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e31be-bee2-47aa-8e57-f987f147fa47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:28.734404 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e31be-bee2-47aa-8e57-f987f147fa47 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:28.795948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1621dac9f0e4ebc9f1c18b242fb54a4', 'request_id': 'req-476ba289-1d58-4bc0-8204-f8fdcaa2137b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:28.805720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1621dac9f0e4ebc9f1c18b242fb54a4', 'request_id': 'req-476ba289-1d58-4bc0-8204-f8fdcaa2137b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:28.807651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 859/1734] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:28 2022] POST /identity/v3/projects => generated 399 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:28.812366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec3a4-4efb-477a-ae4c-b416ff3f461e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.815323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1621dac9f0e4ebc9f1c18b242fb54a4', 'request_id': 'req-476ba289-1d58-4bc0-8204-f8fdcaa2137b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:28.815705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec3a4-4efb-477a-ae4c-b416ff3f461e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.816212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec3a4-4efb-477a-ae4c-b416ff3f461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.847521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] The token cache is being invalidate because project e1621dac9f0e4ebc9f1c18b242fb54a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:28.848123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:28.849008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-476ba289-1d58-4bc0-8204-f8fdcaa2137b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:28.856416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 876/1735] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:28 2022] DELETE /identity/v3/projects/e1621dac9f0e4ebc9f1c18b242fb54a4 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:28.862522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:28.862859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:28.865949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:28.906566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-788ec3a4-4efb-477a-ae4c-b416ff3f461e None None] MFA Rules not processed for user `27d9771e0eee461b80e0ea9c464dadb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:28.908534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-788ec3a4-4efb-477a-ae4c-b416ff3f461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:28.912704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] MFA Rules not processed for user `6ae2e3c1b1b04ce7950a81c33308d560`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:28.919467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:28.989110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:29.072893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 877/1736] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:29.073857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:29.087471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 860/1737] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:29.089149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:29.089547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:29.089968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:29.093598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:29.138027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:29.142556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:29.154125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:29.327545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e9022-7bbf-4568-9e21-d79dc6214b8e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:29.336324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 861/1738] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:29.345773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:29.348486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:29.349672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:29.351960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:29.353106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:29.354497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:29.355548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:29.359226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:29.409509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 878/1739] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:29 2022] POST /identity/v3/users => generated 306 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:29.411402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:29.415266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:29.445353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e590-c501-4ab5-b295-886bf2e0d909 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:29.466257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:29.467871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:29.468682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:29.469624 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:29.471198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:29.477017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:29.575904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 879/1740] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:29 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:29.577298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:29.588214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:29.674142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb6b5e-ed13-413b-a3c8-0fea03357d28 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:29.852343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:29.853132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:29.861302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eb5f9-cbd4-4931-a8d0-66409940ea66 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:29.870176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d00819-3fcf-4b99-b410-63d87632a284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:29.871325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d00819-3fcf-4b99-b410-63d87632a284 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:29.872834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d00819-3fcf-4b99-b410-63d87632a284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:29.873364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d00819-3fcf-4b99-b410-63d87632a284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:29.875800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:29.876250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:29.887010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:29.891090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d00819-3fcf-4b99-b410-63d87632a284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:29.895320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d00819-3fcf-4b99-b410-63d87632a284 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:29.935212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 880/1741] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:29.969745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:29.970529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:29.971057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.006168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.009095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.028151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:30.033475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:30.035195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:30.093105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 862/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:30.094625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.150864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 881/1743] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:30.151995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.155366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:30.174659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e3f1-ba7d-4519-a750-17f021a5724e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:30.183834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:30.185030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.185440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.185730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] PATH_INFO: `/v3/projects/c50931e94a10469bbdee693fadde43d2` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.187366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50931e94a10469bbdee693fadde43d2)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.189640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.216420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:30.302945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50931e94a10469bbdee693fadde43d2', 'request_id': 'req-08a27245-a317-413e-8412-b9ed0f5c1acd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:30.306468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150b200-8ff1-494c-a226-d796d7f68b51 service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:30.320913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50931e94a10469bbdee693fadde43d2', 'request_id': 'req-08a27245-a317-413e-8412-b9ed0f5c1acd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:30.345164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50931e94a10469bbdee693fadde43d2', 'request_id': 'req-08a27245-a317-413e-8412-b9ed0f5c1acd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:30.382370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] The token cache is being invalidate because project c50931e94a10469bbdee693fadde43d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:30.382939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:30.384169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:30.386876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 882/1744] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:30 2022] DELETE /identity/v3/projects/c50931e94a10469bbdee693fadde43d2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:30.391800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.393658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:30.394770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:30.395649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.398551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.398955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.403168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.411289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.444218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 863/1745] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:30.446044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.453071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:30.487132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bedc3-c476-4286-8513-9417fa4c24e4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:30.501217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:30.502248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.502395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.502758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.503510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:30.503857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.506839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27245-a317-413e-8412-b9ed0f5c1acd admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:30.508014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc65c0-0596-46e2-b132-a7ab3d545f46 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.520418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:30.521159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.521447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.521732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.522440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.542830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.543008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 864/1746] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:30.546775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.547591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.547919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.597778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:30.601536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:30.628051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 883/1747] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:30 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:30.628845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.630560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:30.635334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 865/1748] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:30.636309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.672469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ddb81-7238-4197-8aea-51a494467cb7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:30.681860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185bd16-a0e0-41a6-a29d-727bb0975f62 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:30.702103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349296dd-9374-4d86-8c76-00a58427489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:30.702822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349296dd-9374-4d86-8c76-00a58427489d admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.703092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349296dd-9374-4d86-8c76-00a58427489d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.703347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349296dd-9374-4d86-8c76-00a58427489d admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.704178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349296dd-9374-4d86-8c76-00a58427489d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.706277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:30.707722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.707722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.708522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] PATH_INFO: `/v3/projects/037fa8f6343d4661b16f6deac8245cb9/users/afca7b7757f9477d908cff8575d10898/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.717333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349296dd-9374-4d86-8c76-00a58427489d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.753320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037fa8f6343d4661b16f6deac8245cb9, user_id=afca7b7757f9477d908cff8575d10898, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:30.756606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:30.798710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 884/1749] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:30 2022] PUT /identity/v3/projects/037fa8f6343d4661b16f6deac8245cb9/users/afca7b7757f9477d908cff8575d10898/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:30.800766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:30.812988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 866/1750] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:30 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:30.818048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:30.818348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:30.819025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:30.874553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:30.876379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:31.000396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7ae81-6e1e-474f-a5ef-08caaed75450 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.043444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:31.063673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 867/1751] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:31.065166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.091446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980202-c885-4dc7-ae0c-a00e9fb8a215 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.106664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.107403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.107771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.108008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.108880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.110791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.134542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 868/1752] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:31.142234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.161624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90268750-bce0-49ad-bfdc-22cb2ea23194 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.181627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.181991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.182328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.182555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.186381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.187223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.188906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.190643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.191785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.192113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.192902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.195473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.226102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 885/1753] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:31.235473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.270816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 869/1754] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:31 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:31.271716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.275396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530ed4-db08-40ec-b78b-273017c13b61 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.287982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.288702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.288991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.289301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.290013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:31.290319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.299043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b635c-651d-41b3-ad83-3a1702ba5f0d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.300685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.306926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:31.314141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.315069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.315390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.315766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] PATH_INFO: `/v3/projects/037fa8f6343d4661b16f6deac8245cb9/users/afca7b7757f9477d908cff8575d10898/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.329495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=037fa8f6343d4661b16f6deac8245cb9, user_id=afca7b7757f9477d908cff8575d10898, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.332364 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.353950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 886/1755] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:31.359018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.387436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 870/1756] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:31 2022] PUT /identity/v3/projects/037fa8f6343d4661b16f6deac8245cb9/users/afca7b7757f9477d908cff8575d10898/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:31.388403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.390338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaca5c9-cd9e-4861-baa2-20768520d1a3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.562726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.563853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.564325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.564685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] PATH_INFO: `/v3/projects/37cd776bd0284b688e59907a5027d662/users/82c7d31862e14db8a39ab12de70c18d7/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.581340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226a34-6fa7-40a9-af43-29600c0bb56a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.613138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3974-7f2f-4694-871d-be15dd9c9aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.613854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3974-7f2f-4694-871d-be15dd9c9aae admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.614167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3974-7f2f-4694-871d-be15dd9c9aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.614425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3974-7f2f-4694-871d-be15dd9c9aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.615181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3974-7f2f-4694-871d-be15dd9c9aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.617445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cd776bd0284b688e59907a5027d662, user_id=82c7d31862e14db8a39ab12de70c18d7, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.622788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.628628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3974-7f2f-4694-871d-be15dd9c9aae admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.654218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 887/1757] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:31 2022] PUT /identity/v3/projects/37cd776bd0284b688e59907a5027d662/users/82c7d31862e14db8a39ab12de70c18d7/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:31.656053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:31.663816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 871/1758] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:31.663816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.663986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.664808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.770607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] MFA Rules not processed for user `afca7b7757f9477d908cff8575d10898`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:31.771915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:31.801960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f25b7-9e79-4c6c-b716-6a6463d51349 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:31.811793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:31.812778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:31.813314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:31.813671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:31.814472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:31.816805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:31.880790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 888/1759] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:31 2022] POST /identity/v3/projects => generated 357 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:31.880790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.006150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 872/1760] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:32.006150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.026063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856addd-0481-4cfc-b0c6-bd086758d3cf None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.130601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:32.150813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec1467-e0db-401e-a07b-d660bba294bd admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.166555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.172455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.173152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.173655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.174658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.175651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.176397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.176686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.176969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.177726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.179401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:32.189653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:32.191680 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 873/1761] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:32.192753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.203791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:32.223824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4ef9-dd03-424c-a751-5404387542e3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.225799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 889/1762] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:32.227140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.231513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:32.238223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.240086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.240487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.240870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.243096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.248274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:32.270476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29378fbb-5641-43ce-a720-1c61d3558609 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.276901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.278480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.278876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.279295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] PATH_INFO: `/v3/users/9afb10fcc08e46d0acd9121726421510` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.280845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afb10fcc08e46d0acd9121726421510)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.284454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:32.294461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 874/1763] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:32 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:32.297398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.299946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:32.442748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afb10fcc08e46d0acd9121726421510'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:32.444707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afb10fcc08e46d0acd9121726421510'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:32.480103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afb10fcc08e46d0acd9121726421510'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:32.495107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694414c0-81b7-4dae-a8dc-e6f8a678da6e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.502478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afb10fcc08e46d0acd9121726421510'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:32.504499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afb10fcc08e46d0acd9121726421510'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:32.519348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.520353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.520732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.520933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.524294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:32.528260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 890/1764] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:32 2022] DELETE /identity/v3/users/9afb10fcc08e46d0acd9121726421510 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:32.535120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.541953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:32.764159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.765430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:32.767981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98daeb8-14a6-415b-8cdb-ac8bf1400d2d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.783481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.784468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.784755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.785035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] PATH_INFO: `/v3/projects/8b7dc1ab4fd2440e86a2e8806588ffda/users/03ee104e7ba24c54af146f260e9e2ea0/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.812607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 875/1765] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:32.818046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.834835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:32.880103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7dc1ab4fd2440e86a2e8806588ffda, user_id=03ee104e7ba24c54af146f260e9e2ea0, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.884947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:32.895529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5988-1fb4-4d2e-bf32-c4a604c9b00a service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:32.910852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b33dd5-f236-4c92-a4aa-a2c23a576e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:32.915731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b33dd5-f236-4c92-a4aa-a2c23a576e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:32.944324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 891/1766] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:32 2022] PUT /identity/v3/projects/8b7dc1ab4fd2440e86a2e8806588ffda/users/03ee104e7ba24c54af146f260e9e2ea0/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:32.945415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b33dd5-f236-4c92-a4aa-a2c23a576e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:32.948999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:32.949276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b33dd5-f236-4c92-a4aa-a2c23a576e88 admin admin] PATH_INFO: `/v3/projects/37cd776bd0284b688e59907a5027d662/users/82c7d31862e14db8a39ab12de70c18d7/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:32.959609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b33dd5-f236-4c92-a4aa-a2c23a576e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cd776bd0284b688e59907a5027d662, user_id=82c7d31862e14db8a39ab12de70c18d7, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:32.962958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:32.967447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b33dd5-f236-4c92-a4aa-a2c23a576e88 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:33.030395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 876/1767] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:32 2022] PUT /identity/v3/projects/37cd776bd0284b688e59907a5027d662/users/82c7d31862e14db8a39ab12de70c18d7/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:33.035745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce73081-c289-4c5b-a6c7-26c995af3dd4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.036614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce73081-c289-4c5b-a6c7-26c995af3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.037800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce73081-c289-4c5b-a6c7-26c995af3dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.108443 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bce73081-c289-4c5b-a6c7-26c995af3dd4 None None] MFA Rules not processed for user `a3099b72043c41ce8daa9bf8457efde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:33.109963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bce73081-c289-4c5b-a6c7-26c995af3dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.172070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:33.219323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a06e90-6a5a-46c4-a528-ebb9715a194e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:33.270185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:33.291831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 877/1768] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:33.293802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b0a2-3a81-4906-80c6-50ef090f71b4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.294379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b0a2-3a81-4906-80c6-50ef090f71b4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.294804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b0a2-3a81-4906-80c6-50ef090f71b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.362809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f360b0a2-3a81-4906-80c6-50ef090f71b4 None None] MFA Rules not processed for user `03ee104e7ba24c54af146f260e9e2ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:33.364002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f360b0a2-3a81-4906-80c6-50ef090f71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.390767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:33.393052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.393616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.395727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.396676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:33.398899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:33.462223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 892/1769] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:33.466048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:33.472156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.580979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 878/1770] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:33.584517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e01c-0352-44a6-86d5-d877f78d7e3e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.584934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e01c-0352-44a6-86d5-d877f78d7e3e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.585855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e01c-0352-44a6-86d5-d877f78d7e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.677321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ceb6e01c-0352-44a6-86d5-d877f78d7e3e None None] MFA Rules not processed for user `82c7d31862e14db8a39ab12de70c18d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:33.679727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ceb6e01c-0352-44a6-86d5-d877f78d7e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.731740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21b31-46f1-4503-bf85-f9df15a280cc admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:33.743398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:33.747730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.748201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.748401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.758352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.876903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:33.878386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:33.887202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 879/1771] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:33.889638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.890280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.890529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 893/1772] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:33.890933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.910792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:33.913805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.923090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] MFA Rules not processed for user `4df5c2b1e22f4c54b05eb77d9ba9818b`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:33.924515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:33.948238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb53a1-f471-43a5-a1f9-a97b1d995913 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:33.963432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:33.964671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:33.965154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:33.965621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] PATH_INFO: `/v3/projects/c891bba09967410a97877d98543b9fc4` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:33.969064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c891bba09967410a97877d98543b9fc4)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:33.971968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:34.019380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 880/1773] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:34.020027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.056455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188193e6-2fd0-44de-9369-583fc9601619 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:34.068266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:34.070442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.071662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.072202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.076594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:34.081151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:34.091278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:34.098179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c891bba09967410a97877d98543b9fc4', 'request_id': 'req-432013f2-bf63-488a-b5c4-79b177b0f5e3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.105235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 881/1774] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:34.108172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.114081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c891bba09967410a97877d98543b9fc4', 'request_id': 'req-432013f2-bf63-488a-b5c4-79b177b0f5e3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.127746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c891bba09967410a97877d98543b9fc4', 'request_id': 'req-432013f2-bf63-488a-b5c4-79b177b0f5e3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.134383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549c7b9-b9dc-4aba-9325-6bb794ff3907 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:34.162130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:34.165781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] The token cache is being invalidate because project c891bba09967410a97877d98543b9fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:34.166584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.168806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.187327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 894/1775] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:33 2022] DELETE /identity/v3/projects/c891bba09967410a97877d98543b9fc4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:34.188232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.194034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.292963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:34.294898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.295194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.295479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.297470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:34.304830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:34.353336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432013f2-bf63-488a-b5c4-79b177b0f5e3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:34.360868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 882/1776] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:34 2022] POST /identity/v3/projects => generated 361 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:34.362354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:34.364458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.364458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.364458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.365020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.367692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.370815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.518668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0d3b-62d3-4719-a516-29482a0e4fd4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:34.521936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:34.527331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:34.530193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:34.531217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.531573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.531976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] PATH_INFO: `/v3/projects/054720b7c40743908feaa90e444f184a/users/ff0b19b489244cbdbe50e7d76479cc32/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.545394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 895/1777] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:34.546473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.547929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.552071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=054720b7c40743908feaa90e444f184a, user_id=ff0b19b489244cbdbe50e7d76479cc32, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:34.555854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:34.566301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ac685-a291-4f82-90b3-328e4ad3df69 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:34.573619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:34.575221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.575791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.576067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] PATH_INFO: `/v3/users/06bb0bf1981b4b858fc4aea0d9e96123` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.577703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06bb0bf1981b4b858fc4aea0d9e96123)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:34.581392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:34.585340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 883/1778] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:34 2022] PUT /identity/v3/projects/054720b7c40743908feaa90e444f184a/users/ff0b19b489244cbdbe50e7d76479cc32/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:34.586432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.603994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.669368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06bb0bf1981b4b858fc4aea0d9e96123'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.671551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06bb0bf1981b4b858fc4aea0d9e96123'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.683578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06bb0bf1981b4b858fc4aea0d9e96123'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.709001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06bb0bf1981b4b858fc4aea0d9e96123'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.709819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-64bfe361-305e-4157-9ffa-7ddba8cf3c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06bb0bf1981b4b858fc4aea0d9e96123'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:34.718522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:34.738724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 896/1779] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:34 2022] DELETE /identity/v3/users/06bb0bf1981b4b858fc4aea0d9e96123 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:34.738724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.738724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.739118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.785317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993558-fdd1-4bf9-95bf-6fc3929356ff admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:34.789287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] MFA Rules not processed for user `ff0b19b489244cbdbe50e7d76479cc32`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:34.790523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.856180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:34.932246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 897/1780] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:34.932246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:34.933056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:34.953905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:34.954608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:34.954899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:34.956036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:34.956931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:34.959353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.005403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 884/1781] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:34 2022] POST /identity/v3/users => generated 287 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:35.008301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.014016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.041826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854804d-be69-4a10-a90c-1c287b044c4a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.060996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.063582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.064162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.064696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.073074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.078602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.091395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a9d83-24ea-4ea0-8b11-667faaaf68c8 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.097640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.098558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.098929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.099315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.101975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.141885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 885/1782] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:35 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:35.154522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.172072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.204133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.206595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.230432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 898/1783] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:35.231463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.240058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.278795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5f93-f0f7-4dec-927a-9307add63afd service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.352480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:35.372097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d17543-96f0-4a16-bbaa-258d20c3f824 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.384384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.385226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.385511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.385791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] PATH_INFO: `/v3/projects/58f45a726153495fb7177c712af4d6cd` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.390198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f45a726153495fb7177c712af4d6cd)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.391490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.393756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.394931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.395364 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.395786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.396661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.401632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.441049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 886/1784] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:35.442211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.474826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b679f-a083-40d4-aecd-8d15960a8c30 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.490883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.492902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.494035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.495353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.496872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.499389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.523340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f45a726153495fb7177c712af4d6cd', 'request_id': 'req-82419f28-db8b-4238-9385-1d1769ab5e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:35.539084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f45a726153495fb7177c712af4d6cd', 'request_id': 'req-82419f28-db8b-4238-9385-1d1769ab5e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:35.548149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 887/1785] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:35 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:35.549408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.556414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f45a726153495fb7177c712af4d6cd', 'request_id': 'req-82419f28-db8b-4238-9385-1d1769ab5e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:35.563774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239ddf-36b0-4e7d-8982-dc495f6df76e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.580356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] The token cache is being invalidate because project 58f45a726153495fb7177c712af4d6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:35.580654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:35.581844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:35.590283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 899/1786] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:35 2022] DELETE /identity/v3/projects/58f45a726153495fb7177c712af4d6cd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:35.590283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.593463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.727819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.730746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.731828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.733620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] PATH_INFO: `/v3/projects/92ae47f264b74177bf26962ce61847f7/users/1b108fed63964993980bf57c7b507af4/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.746864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419f28-db8b-4238-9385-1d1769ab5e2f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.753030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7be00-ed69-4331-ab94-c47d20bb6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.754054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7be00-ed69-4331-ab94-c47d20bb6d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.754848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7be00-ed69-4331-ab94-c47d20bb6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.755469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7be00-ed69-4331-ab94-c47d20bb6d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.756820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7be00-ed69-4331-ab94-c47d20bb6d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.759450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7be00-ed69-4331-ab94-c47d20bb6d45 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.773717 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ae47f264b74177bf26962ce61847f7, user_id=1b108fed63964993980bf57c7b507af4, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.780157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.781477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 900/1787] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:35.782043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:35.786756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.787410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.788782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.806072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 888/1788] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:35 2022] PUT /identity/v3/projects/92ae47f264b74177bf26962ce61847f7/users/1b108fed63964993980bf57c7b507af4/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:35.807802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.822662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:35.824465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.905868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe41e-e5de-4450-b75d-46bd9d85c2da admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.920603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.921448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.921736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.924692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] PATH_INFO: `/v3/projects/e4b8f55f8b82496a8a3f92e37bdda422/users/9ebeb18af01246f78ca6eab94ea019fe/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.951684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 901/1789] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:35.951684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:35.953310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:35.968877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b8f55f8b82496a8a3f92e37bdda422, user_id=9ebeb18af01246f78ca6eab94ea019fe, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.971827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.976295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1ad2-c6d0-46d3-9add-e847b8ee5e26 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:35.985453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dea13-044e-4857-b5e3-85006895f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:35.986454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dea13-044e-4857-b5e3-85006895f64f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:35.986954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dea13-044e-4857-b5e3-85006895f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:35.987431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dea13-044e-4857-b5e3-85006895f64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:35.988686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dea13-044e-4857-b5e3-85006895f64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:35.991213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dea13-044e-4857-b5e3-85006895f64f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:35.993252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:35.997659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 889/1790] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:35 2022] PUT /identity/v3/projects/e4b8f55f8b82496a8a3f92e37bdda422/users/9ebeb18af01246f78ca6eab94ea019fe/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:35.999745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:36.003828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.015516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 902/1791] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:36.016846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.017214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.017701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.056146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:36.057039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.181202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4193-b82d-4fd7-b62a-618507f1cde2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:36.187262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:36.188983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.189600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.190508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] PATH_INFO: `/v3/users/27d9771e0eee461b80e0ea9c464dadb3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.192318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d9771e0eee461b80e0ea9c464dadb3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:36.195350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:36.248378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 903/1792] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:36.249557 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:36.269744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894988ed-c5e2-49fb-9da1-27ba62147157 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:36.282311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:36.284366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.285700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.286907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.290170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:36.297226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:36.316257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 904/1793] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:36.317383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:36.334363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da4b3-1d2a-4ded-a20f-a222248cbf1e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:36.337512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d9771e0eee461b80e0ea9c464dadb3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:36.340570 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:36.340865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d9771e0eee461b80e0ea9c464dadb3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:36.341803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.342757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.342878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] PATH_INFO: `/v3/projects/92ae47f264b74177bf26962ce61847f7/users/1b108fed63964993980bf57c7b507af4/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.348100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ae47f264b74177bf26962ce61847f7, user_id=1b108fed63964993980bf57c7b507af4, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:36.354000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:36.369335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d9771e0eee461b80e0ea9c464dadb3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:36.388360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 905/1794] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:36 2022] PUT /identity/v3/projects/92ae47f264b74177bf26962ce61847f7/users/1b108fed63964993980bf57c7b507af4/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:36.390010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:36.404957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d9771e0eee461b80e0ea9c464dadb3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:36.416679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:36.421416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d9771e0eee461b80e0ea9c464dadb3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:36.437784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 890/1795] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:35 2022] DELETE /identity/v3/users/27d9771e0eee461b80e0ea9c464dadb3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:36.439743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:36.448305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.541492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc78ad-cc71-4a32-909e-eefe57ace846 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:36.566928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:36.568373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4701d7-b0e5-4d9a-b39a-8a9165308cf4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:36.568858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.570245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.571182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.572905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:36.574060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:36.577319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121a70-63dd-4566-a97e-2027a2ff63a0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:36.577758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c15365-89d2-4405-8f29-3cd63e655247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:36.579258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15365-89d2-4405-8f29-3cd63e655247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.579733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15365-89d2-4405-8f29-3cd63e655247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.580221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15365-89d2-4405-8f29-3cd63e655247 admin admin] PATH_INFO: `/v3/projects/e4b8f55f8b82496a8a3f92e37bdda422/users/9ebeb18af01246f78ca6eab94ea019fe/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.584292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c15365-89d2-4405-8f29-3cd63e655247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b8f55f8b82496a8a3f92e37bdda422, user_id=9ebeb18af01246f78ca6eab94ea019fe, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:36.588007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c15365-89d2-4405-8f29-3cd63e655247 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:36.605847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 891/1796] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:36 2022] PUT /identity/v3/projects/e4b8f55f8b82496a8a3f92e37bdda422/users/9ebeb18af01246f78ca6eab94ea019fe/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:36.607201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1f5b4-e7cf-40d1-9770-4172d234ee45 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.607496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1f5b4-e7cf-40d1-9770-4172d234ee45 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.607812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1f5b4-e7cf-40d1-9770-4172d234ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.624532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 906/1797] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:36.624532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.624532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.651169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-71f1f5b4-e7cf-40d1-9770-4172d234ee45 None None] MFA Rules not processed for user `1b108fed63964993980bf57c7b507af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:36.653342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-71f1f5b4-e7cf-40d1-9770-4172d234ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.655340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.719138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:36.723213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.897218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 892/1798] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:36.899247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.900611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.901084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.903403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 907/1799] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:36.904665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:36.908103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.940885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce052b-0100-4be8-8e0d-040c96e4b940 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:36.944409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] MFA Rules not processed for user `9ebeb18af01246f78ca6eab94ea019fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:36.946090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:36.949494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:36.950387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:36.950832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:36.951268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:36.952153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:36.954725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:36.973158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:37.025793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 908/1800] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:36 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:37.026793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.032166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:37.098772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:37.111761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 893/1801] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:37.115859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.120561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:37.216017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e6ec5-90c6-4d1a-a317-96695bc73fe1 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.220158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce819f5-1bbc-4dd0-918a-8a2e999768a8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.230853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.233640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.234185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.234537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.381459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.383241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.384105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.384626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.421874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:37.425544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:37.440847 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 909/1802] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:37.442096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.573263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8137c82-a463-497d-83ff-4779cb60334d service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.584134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.584134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.584444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.584658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.586332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:37.588755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:37.650858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 910/1803] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:37 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:37.652064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.661954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:37.680069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:37.689374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:37.693791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe07c-1fd3-4595-9da0-8e32a328dbaf admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.700179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.702206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.702402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.702863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.736240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 894/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:37.738320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.750719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:37.767561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8461-f216-4832-adb8-fea205e14a9d service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.782056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.783031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.783403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.783824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.784664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:37.786558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:37.813907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 895/1805] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:37.815563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.838164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07487e61-f04e-491e-988d-90cfc449369c admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.865402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.871376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.872125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.872568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.875569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:37.886795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:37.921360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 896/1806] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:37.922418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:37.923260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:37.927693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:37.937964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdebc84-6912-4c87-ac86-c8ea5ff2fad7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:37.945154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:37.946158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:37.946521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:37.947297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:37.950612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:37.965676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 911/1807] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:37.969455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:38.008146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:38.015987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d221d-81d2-49ce-9316-ce021233cc03 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:38.032298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:38.034166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ef0a-63da-488e-a86c-79f863dfafa7 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:38.038168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:38.043743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:38.047840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:38.048726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 897/1808] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:38.049988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] PATH_INFO: `/v3/projects/e403eeefc0fa4c82ac4de8270a348083/users/5782cb076dc844b0a1d9b17131d008e8/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:38.136436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e403eeefc0fa4c82ac4de8270a348083, user_id=5782cb076dc844b0a1d9b17131d008e8, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:38.153389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:38.209625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 912/1809] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:37 2022] PUT /identity/v3/projects/e403eeefc0fa4c82ac4de8270a348083/users/5782cb076dc844b0a1d9b17131d008e8/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:38.217475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:38.218712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:38.218995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:38.300917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] MFA Rules not processed for user `5782cb076dc844b0a1d9b17131d008e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:38.302144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:38.440798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:38.506736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 898/1810] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:38.518892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:38.644423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17410b-fb7f-4f38-879b-e546802301ac None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:38.676844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:38.677933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:38.678410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:38.678927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:38.680103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:38.700109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:38.844253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b376959-ea7b-4358-b41d-18be1a0335c2 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:38.854416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 899/1811] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:38 2022] POST /identity/v3/projects => generated 373 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:38.858457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:38.860479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:38.860479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:38.860821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:38.861848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:38.871330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:39.175141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:39.205317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100665-009b-486e-b5da-1eb10651e0a2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:39.225316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:39.231473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:39.235350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23e8a8-6c53-48c2-b749-64f4f292f071 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:39.235727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.236222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.236706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.240759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:39.251634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:39.285061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 913/1812] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:39.287489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0910-c2e6-4534-8d6b-664fdba3930d None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.288048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0910-c2e6-4534-8d6b-664fdba3930d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.289287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0910-c2e6-4534-8d6b-664fdba3930d None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.294793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 914/1813] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:33:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:39.333160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.333653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.334849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.341498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 900/1814] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:38 2022] POST /identity/v3/users => generated 293 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:39.348904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:39.374617 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68326ea-3f2e-4ab7-a76f-e6216e92ab65 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:39.380779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:39.384039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:39.407086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:39.409306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.410385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.410385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.414216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:39.418651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:39.462042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 901/1815] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:39.462873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:39.476830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a938d4-d416-4ad7-83b7-d9f996ffa9d6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:39.484904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:39.485995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.486285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.486679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] PATH_INFO: `/v3/projects/8797e9ae40594d20aacb9446919f8cc9/users/8696426e94d74c32b76ede30003cbc7d/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.526332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8797e9ae40594d20aacb9446919f8cc9, user_id=8696426e94d74c32b76ede30003cbc7d, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:39.531176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:39.568111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 902/1816] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:39 2022] PUT /identity/v3/projects/8797e9ae40594d20aacb9446919f8cc9/users/8696426e94d74c32b76ede30003cbc7d/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:39.574633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:39.657416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:39.697169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faaa97-cc1b-44c0-97fd-f236f4f714d4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:39.703938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:39.705288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.705770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.707141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.708250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:39.710725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:39.727025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 903/1817] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:33:39.733737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:39.756914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b47b-5fba-4fdd-a880-94eb79dda199 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:39.759993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 915/1818] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:39.776522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b0b8a-9423-4819-ac4c-bbfee4bb12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:39.778196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0b8a-9423-4819-ac4c-bbfee4bb12d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.778532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0b8a-9423-4819-ac4c-bbfee4bb12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.778772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0b8a-9423-4819-ac4c-bbfee4bb12d8 admin admin] PATH_INFO: `/v3/projects/8797e9ae40594d20aacb9446919f8cc9/users/8696426e94d74c32b76ede30003cbc7d/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.784286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:39.785285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b0b8a-9423-4819-ac4c-bbfee4bb12d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8797e9ae40594d20aacb9446919f8cc9, user_id=8696426e94d74c32b76ede30003cbc7d, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:39.789350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:39.791877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b0b8a-9423-4819-ac4c-bbfee4bb12d8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:39.814491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 904/1819] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:39 2022] PUT /identity/v3/projects/8797e9ae40594d20aacb9446919f8cc9/users/8696426e94d74c32b76ede30003cbc7d/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:39.816927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:39.817230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:39.817529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:39.854453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad62fc-5779-4bc4-aa29-8dca28bc106c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:39.857756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] MFA Rules not processed for user `8696426e94d74c32b76ede30003cbc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:39.859658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:39.999154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 905/1820] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:40.027475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:40.078725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:40.121520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:40.125249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:40.126106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:40.126807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:40.149955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:40.156282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:40.171398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1182e-06a2-4528-ae5c-8fd6c2f44caf None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:40.176272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:40.176956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:40.178613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:40.179229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:40.211430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:40.212977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:40.224961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 916/1821] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:40.228801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:40.232317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 906/1822] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:40.235153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:40.521566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70f6ac-0164-40c6-a913-9574077ff113 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:40.580798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:40.582425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:40.582881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:40.584555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] PATH_INFO: `/v3/projects/033a4f29bf784b42a6b9373d7b301a0b` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:40.607297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033a4f29bf784b42a6b9373d7b301a0b)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:40.611438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:40.871494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033a4f29bf784b42a6b9373d7b301a0b', 'request_id': 'req-2c89c784-48f4-4826-ad30-3eae5cb54a04'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:40.896741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033a4f29bf784b42a6b9373d7b301a0b', 'request_id': 'req-2c89c784-48f4-4826-ad30-3eae5cb54a04'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:40.929561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033a4f29bf784b42a6b9373d7b301a0b', 'request_id': 'req-2c89c784-48f4-4826-ad30-3eae5cb54a04'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:40.946409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:40.989016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] The token cache is being invalidate because project 033a4f29bf784b42a6b9373d7b301a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:40.990414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:40.993764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:40.997334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 917/1823] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:40 2022] DELETE /identity/v3/projects/033a4f29bf784b42a6b9373d7b301a0b => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:41.002606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:41.024743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61006d79-52ea-4591-83e4-d3d335f6bb3d service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:41.071317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:41.077090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:41.359753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89c784-48f4-4826-ad30-3eae5cb54a04 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:41.364981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:41.372045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:41.372542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:41.374758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:41.377091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:41.377091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:41.377524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] PATH_INFO: `/v3/users/82c7d31862e14db8a39ab12de70c18d7` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:41.377881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] PATH_INFO: `/v3/users/3f20134aacfc4abc8017b894d4f1b436` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:41.383197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f20134aacfc4abc8017b894d4f1b436)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:41.384574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c7d31862e14db8a39ab12de70c18d7)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:41.393295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:41.393556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:41.528211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c7d31862e14db8a39ab12de70c18d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.529676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c7d31862e14db8a39ab12de70c18d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.543991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c7d31862e14db8a39ab12de70c18d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.593729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c7d31862e14db8a39ab12de70c18d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.615069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4fb40bb1-dceb-4530-9f06-0f25a0bf0ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c7d31862e14db8a39ab12de70c18d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.617286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f20134aacfc4abc8017b894d4f1b436'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.619551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f20134aacfc4abc8017b894d4f1b436'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.628831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 907/1824] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:41 2022] DELETE /identity/v3/users/82c7d31862e14db8a39ab12de70c18d7 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:41.640476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f20134aacfc4abc8017b894d4f1b436'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.672751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f20134aacfc4abc8017b894d4f1b436'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.674197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f20134aacfc4abc8017b894d4f1b436'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:41.703915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 918/1825] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:41 2022] DELETE /identity/v3/users/3f20134aacfc4abc8017b894d4f1b436 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:41.710476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:41.710858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:41.711241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:41.739358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:41.741110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:41.868731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:41.946388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 908/1826] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:42.022180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:42.025388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:42.050741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:42.053343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:42.074204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8e419-b8a5-4c4d-82b4-b41edbd88822 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:42.088346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:42.089273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:42.089548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:42.090041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] PATH_INFO: `/v3/users/5782cb076dc844b0a1d9b17131d008e8` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:42.092559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5782cb076dc844b0a1d9b17131d008e8)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:42.094693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:42.157309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b0ef5-27d1-4709-9fce-02e0110b4e72 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:42.167601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fdcb2-1667-4fd5-9add-a6a999389c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:42.169578 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fdcb2-1667-4fd5-9add-a6a999389c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:42.169831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fdcb2-1667-4fd5-9add-a6a999389c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:42.170310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fdcb2-1667-4fd5-9add-a6a999389c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:42.187023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fdcb2-1667-4fd5-9add-a6a999389c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:42.189305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fdcb2-1667-4fd5-9add-a6a999389c7d service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:42.194633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5782cb076dc844b0a1d9b17131d008e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.196390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5782cb076dc844b0a1d9b17131d008e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.205805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 919/1827] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:42.208678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5782cb076dc844b0a1d9b17131d008e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.227725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5782cb076dc844b0a1d9b17131d008e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.238688 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5782cb076dc844b0a1d9b17131d008e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.247997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 909/1828] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:42 2022] DELETE /identity/v3/users/5782cb076dc844b0a1d9b17131d008e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:42.252780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:42.253397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:42.253852 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:42.277553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:42.278996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:42.295827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:42.402004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 920/1829] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:42.442504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:42.446851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:42.685289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d4b7d-36b6-4937-a1e8-ac3b97852bea admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:42.696053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510773c-d031-4a59-91f7-2498ed785c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:42.697426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510773c-d031-4a59-91f7-2498ed785c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:42.698062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510773c-d031-4a59-91f7-2498ed785c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:42.698696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510773c-d031-4a59-91f7-2498ed785c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:42.727368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510773c-d031-4a59-91f7-2498ed785c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:42.734827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510773c-d031-4a59-91f7-2498ed785c39 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:42.759889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 910/1830] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:42.799485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:42.802236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:42.827017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff2bbc-4190-4b14-826a-93d1cf0a147f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:42.837778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:42.839942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:42.840741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:42.841565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] PATH_INFO: `/v3/users/03ee104e7ba24c54af146f260e9e2ea0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:42.844310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ee104e7ba24c54af146f260e9e2ea0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:42.848417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:42.948283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ee104e7ba24c54af146f260e9e2ea0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.949443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ee104e7ba24c54af146f260e9e2ea0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:42.961959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ee104e7ba24c54af146f260e9e2ea0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:43.001914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ee104e7ba24c54af146f260e9e2ea0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:43.002876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ee104e7ba24c54af146f260e9e2ea0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:43.026038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 921/1831] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:42 2022] DELETE /identity/v3/users/03ee104e7ba24c54af146f260e9e2ea0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:43.037216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:43.037508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:43.038975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:43.086512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:43.087934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:43.271053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:43.301697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 911/1832] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:43.345040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:43.351850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:43.666588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837918c7-f9a6-4cbe-add5-ca69db91147a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:43.683210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096246-f4bd-45d4-bbec-036858af04e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:43.683717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096246-f4bd-45d4-bbec-036858af04e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:43.684008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096246-f4bd-45d4-bbec-036858af04e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:43.684300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096246-f4bd-45d4-bbec-036858af04e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:43.708002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096246-f4bd-45d4-bbec-036858af04e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:43.708002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096246-f4bd-45d4-bbec-036858af04e5 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:43.744307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:43.747078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:43.763313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 922/1833] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:43.817571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe87c7-0c52-441f-b901-3426366e49f2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:43.842939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:43.848253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:43.849143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:43.852148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] PATH_INFO: `/v3/projects/37cd776bd0284b688e59907a5027d662` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:43.856927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cd776bd0284b688e59907a5027d662)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:43.861792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:44.092225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cd776bd0284b688e59907a5027d662', 'request_id': 'req-cd69050e-ed8e-409b-bb98-a3521d120aa1'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.105883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cd776bd0284b688e59907a5027d662', 'request_id': 'req-cd69050e-ed8e-409b-bb98-a3521d120aa1'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.120433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cd776bd0284b688e59907a5027d662', 'request_id': 'req-cd69050e-ed8e-409b-bb98-a3521d120aa1'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.182630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] The token cache is being invalidate because project 37cd776bd0284b688e59907a5027d662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:44.183170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.184509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cd69050e-ed8e-409b-bb98-a3521d120aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.193411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 912/1834] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:43 2022] DELETE /identity/v3/projects/37cd776bd0284b688e59907a5027d662 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:44.195844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:44.196143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:44.196422 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:44.240609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:44.243582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:44.306867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:44.378143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 923/1835] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:44.393702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:44.395221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:44.395924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:44.432327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:44.434758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:44.455126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 913/1836] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:44.458270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:44.480114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73772cd2-e06c-4e17-b97c-6e68fadd6845 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:44.490258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:44.492195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:44.492743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:44.494353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:44.494823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:44.496220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:44.499022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:44.529984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 924/1837] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:44.534765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:44.538082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:44.542066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:44.562790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25611bae-55eb-41d8-92f6-5a8f100ae50f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:44.572506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:44.573913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:44.574541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:44.575063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:44.576438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:44.580872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:44.612018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a041b-7b74-48c3-aa9a-7ead4467eb4f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:44.646102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:44.649012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:44.652869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:44.653040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] PATH_INFO: `/v3/projects/8c77b4620f4542ab8c9f7d8b3af6c524` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:44.656501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c77b4620f4542ab8c9f7d8b3af6c524)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:44.662362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:44.667176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 925/1838] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:44 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:44.672604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:44.783812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c77b4620f4542ab8c9f7d8b3af6c524', 'request_id': 'req-dd9d33db-531d-47f9-bb25-538dea9291fd'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.797678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c77b4620f4542ab8c9f7d8b3af6c524', 'request_id': 'req-dd9d33db-531d-47f9-bb25-538dea9291fd'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.811553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c77b4620f4542ab8c9f7d8b3af6c524', 'request_id': 'req-dd9d33db-531d-47f9-bb25-538dea9291fd'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.851165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] The token cache is being invalidate because project 8c77b4620f4542ab8c9f7d8b3af6c524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:44.851809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.852838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:44.855263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 914/1839] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:44 2022] DELETE /identity/v3/projects/8c77b4620f4542ab8c9f7d8b3af6c524 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:44.861161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:44.861552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3981c7f-5bc5-4778-8f9e-d4690562170c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:44.864255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:45.124018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd80fd-29a8-4fe9-8a6d-74b6bc4ba57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:45.125145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd80fd-29a8-4fe9-8a6d-74b6bc4ba57c admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.125634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd80fd-29a8-4fe9-8a6d-74b6bc4ba57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.126123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd80fd-29a8-4fe9-8a6d-74b6bc4ba57c admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.127477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd80fd-29a8-4fe9-8a6d-74b6bc4ba57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:45.129972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:45.138247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd80fd-29a8-4fe9-8a6d-74b6bc4ba57c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:45.140711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d33db-531d-47f9-bb25-538dea9291fd admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:45.167349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:45.170704 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.171289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.173817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] PATH_INFO: `/v3/users/afca7b7757f9477d908cff8575d10898` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.178851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afca7b7757f9477d908cff8575d10898)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:45.190525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:45.220908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 926/1840] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:44 2022] POST /identity/v3/users => generated 291 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:33:45.244017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91d4a-8ca6-4102-bba7-d6ebda251b96 None None] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.244752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91d4a-8ca6-4102-bba7-d6ebda251b96 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.245220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91d4a-8ca6-4102-bba7-d6ebda251b96 None None] PATH_INFO: `/` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.247926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 927/1841] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:33:45 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:33:45.249470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91d4a-8ca6-4102-bba7-d6ebda251b96 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:45.253136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7ba91d4a-8ca6-4102-bba7-d6ebda251b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:45.300108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91d4a-8ca6-4102-bba7-d6ebda251b96 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:45.321652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:45.325636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.326830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.328893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.332140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:45.340787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:45.373012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 928/1842] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:45.378239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:45.396597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afca7b7757f9477d908cff8575d10898'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:45.397337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afca7b7757f9477d908cff8575d10898'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:45.400105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64186f39-3c66-499d-ae78-5624e56ada1f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:45.411203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:45.411988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afca7b7757f9477d908cff8575d10898'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:45.413513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.414064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.414610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.415807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:45.419869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:45.443271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afca7b7757f9477d908cff8575d10898'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:45.453689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 929/1843] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:45.457200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6a87d052-2745-4aad-a956-7bfe55592cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afca7b7757f9477d908cff8575d10898'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:45.457461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:45.460875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:45.468468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 915/1844] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:44 2022] DELETE /identity/v3/users/afca7b7757f9477d908cff8575d10898 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:45.484337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f21fc-b35b-4274-8811-d0b22a98ce85 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:45.497706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:45.541856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.542327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.542621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.576626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:45.577889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:45.640654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48a2d6-f0d8-4c32-b116-2c5d0034e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:45.641589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48a2d6-f0d8-4c32-b116-2c5d0034e21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.641921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48a2d6-f0d8-4c32-b116-2c5d0034e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.642151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48a2d6-f0d8-4c32-b116-2c5d0034e21f admin admin] PATH_INFO: `/v3/projects/294ec837450b46c480268a312a76cf37/users/2ad7d6fa24734090837c31d961e17e96/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.683183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48a2d6-f0d8-4c32-b116-2c5d0034e21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=294ec837450b46c480268a312a76cf37, user_id=2ad7d6fa24734090837c31d961e17e96, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:45.688398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48a2d6-f0d8-4c32-b116-2c5d0034e21f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:45.734122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 930/1845] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:45 2022] PUT /identity/v3/projects/294ec837450b46c480268a312a76cf37/users/2ad7d6fa24734090837c31d961e17e96/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:45.741310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:45.743473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:45.743806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:45.754698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 916/1846] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:45.808941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:45.813263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:45.832964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] MFA Rules not processed for user `2ad7d6fa24734090837c31d961e17e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:45.836061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:45.852135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2767d77-257d-4582-a7f6-b99e4222419a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:46.026453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 931/1847] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:46.037311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:46.039757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:46.064091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:46.065375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:46.065884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:46.066384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:46.082159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:46.087991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:46.093821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:46.121426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 917/1848] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:33:46.185275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d58c-d5e8-4d36-b7b5-87f12ec8cff0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:46.192265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:46.193472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:46.194127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:46.194762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:46.212285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:46.215117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:46.234279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 932/1849] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:33:46.274523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:46.286092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:46.289915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:46.406250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:46.560359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64daf2-febb-459d-ac97-edb6c5013de8 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:46.581832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:46.590864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:46.592034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:46.593594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] PATH_INFO: `/v3/users/2ad7d6fa24734090837c31d961e17e96` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:46.596764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b4ad-a904-479e-ac90-f6ccda1a968a service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:46.603692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad7d6fa24734090837c31d961e17e96)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:46.610492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:46.620137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:46.621484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:46.622036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:46.622479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] PATH_INFO: `/v3/projects/e403eeefc0fa4c82ac4de8270a348083` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:46.630403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e403eeefc0fa4c82ac4de8270a348083)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:46.633360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:46.761058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad7d6fa24734090837c31d961e17e96'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.761905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad7d6fa24734090837c31d961e17e96'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.776614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e403eeefc0fa4c82ac4de8270a348083', 'request_id': 'req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.777373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad7d6fa24734090837c31d961e17e96'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.791249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e403eeefc0fa4c82ac4de8270a348083', 'request_id': 'req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.809607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e403eeefc0fa4c82ac4de8270a348083', 'request_id': 'req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.810685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad7d6fa24734090837c31d961e17e96'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.811556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad7d6fa24734090837c31d961e17e96'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.837144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 933/1850] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:46 2022] DELETE /identity/v3/users/2ad7d6fa24734090837c31d961e17e96 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:46.839199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] The token cache is being invalidate because project e403eeefc0fa4c82ac4de8270a348083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:46.839499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.840791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e436ef0f-e3a9-47b0-8a05-08c4681dbeaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:46.841747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:46.846211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 918/1851] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:46 2022] DELETE /identity/v3/projects/e403eeefc0fa4c82ac4de8270a348083 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:46.846211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:46.846211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:46.846211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:46.847850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:46.878571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:46.880154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.002848 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 919/1852] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:47.004097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.005661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.017046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e28b-f8cf-4d4b-9e70-28a34e19cf50 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.025775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.026670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.026974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.027230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] PATH_INFO: `/v3/projects/8b7dc1ab4fd2440e86a2e8806588ffda` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.029504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa97dd-4a56-49fa-b0fb-63d8d1e14f4d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.030978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7dc1ab4fd2440e86a2e8806588ffda)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.033109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.040402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.041431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.041673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.042198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] PATH_INFO: `/v3/users/8696426e94d74c32b76ede30003cbc7d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.043855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8696426e94d74c32b76ede30003cbc7d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.045989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.075140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:47.120453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7dc1ab4fd2440e86a2e8806588ffda', 'request_id': 'req-7ac04e42-21a3-4634-a880-ed06a164bff4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.124805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:47.129381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7dc1ab4fd2440e86a2e8806588ffda', 'request_id': 'req-7ac04e42-21a3-4634-a880-ed06a164bff4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.135349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8696426e94d74c32b76ede30003cbc7d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.136518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8696426e94d74c32b76ede30003cbc7d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.144076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7dc1ab4fd2440e86a2e8806588ffda', 'request_id': 'req-7ac04e42-21a3-4634-a880-ed06a164bff4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.164374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8696426e94d74c32b76ede30003cbc7d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.183800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8696426e94d74c32b76ede30003cbc7d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.184297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] The token cache is being invalidate because project 8b7dc1ab4fd2440e86a2e8806588ffda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:47.184902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.186755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.191867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 934/1853] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:46 2022] DELETE /identity/v3/projects/8b7dc1ab4fd2440e86a2e8806588ffda => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:47.192896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.194757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.196799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8696426e94d74c32b76ede30003cbc7d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.207741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 920/1854] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:47 2022] DELETE /identity/v3/users/8696426e94d74c32b76ede30003cbc7d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:47.208495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.210475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.281214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04e42-21a3-4634-a880-ed06a164bff4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.292164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627abb3-6753-4ab7-8602-ab4b1266c195 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.298687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.299402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.299729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.300014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.302585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.379837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.380937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.381281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.382130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] PATH_INFO: `/v3/projects/037fa8f6343d4661b16f6deac8245cb9` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.383725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037fa8f6343d4661b16f6deac8245cb9)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.386922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.406453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.408435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.423845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 921/1855] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:47.425086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.427026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.447083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eeb13-966d-439a-82b5-2218597d3b1b service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.455542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.457121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.457990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.458330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] PATH_INFO: `/v3/users/1b108fed63964993980bf57c7b507af4` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.461646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b108fed63964993980bf57c7b507af4)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.465263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.473402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037fa8f6343d4661b16f6deac8245cb9', 'request_id': 'req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.485155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037fa8f6343d4661b16f6deac8245cb9', 'request_id': 'req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.493327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037fa8f6343d4661b16f6deac8245cb9', 'request_id': 'req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.511655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] The token cache is being invalidate because project 037fa8f6343d4661b16f6deac8245cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:47.512042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.512883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0ad40d3b-58f2-41fb-8e1a-c713c626d8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.516572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 935/1856] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:47 2022] DELETE /identity/v3/projects/037fa8f6343d4661b16f6deac8245cb9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:47.523856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65e34-c084-45de-bfec-5f659410d012 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.524288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65e34-c084-45de-bfec-5f659410d012 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.524650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65e34-c084-45de-bfec-5f659410d012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.547378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-37d65e34-c084-45de-bfec-5f659410d012 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:47.552087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-37d65e34-c084-45de-bfec-5f659410d012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.567609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:47.593899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:47.606362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b108fed63964993980bf57c7b507af4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.608108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b108fed63964993980bf57c7b507af4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.623025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b108fed63964993980bf57c7b507af4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.648254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b108fed63964993980bf57c7b507af4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.658192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 936/1857] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:47.660793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b108fed63964993980bf57c7b507af4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.669186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 922/1858] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:47 2022] DELETE /identity/v3/users/1b108fed63964993980bf57c7b507af4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:47.670467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.670945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.671122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.709284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:47.711991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.792140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.796657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:47.812314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 937/1859] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:47.817355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.832118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d457e-4763-4c93-9baf-57b063b98d7b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.838888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.839746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.840200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e835ba-112b-4642-b6d0-589ecf628309 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.840693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.841078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.842130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:47.842520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.844607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.851801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.854727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.855716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.856281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] PATH_INFO: `/v3/projects/8797e9ae40594d20aacb9446919f8cc9` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.859939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8797e9ae40594d20aacb9446919f8cc9)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.862048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 938/1860] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:47.865609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.868257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.879517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1cb73-95a6-47a2-9848-7dcd4cb3062b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:47.885654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:47.886430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:47.887073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:47.887073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:47.887913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:47.890285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:47.938448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 939/1861] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:47 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:47.939491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:47.970159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8797e9ae40594d20aacb9446919f8cc9', 'request_id': 'req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.983358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8797e9ae40594d20aacb9446919f8cc9', 'request_id': 'req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:47.991577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8797e9ae40594d20aacb9446919f8cc9', 'request_id': 'req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.023669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] The token cache is being invalidate because project 8797e9ae40594d20aacb9446919f8cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:48.023669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.024379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a909bbc1-5fdb-4ef0-99e5-17a316facdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.026198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 923/1862] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:47 2022] DELETE /identity/v3/projects/8797e9ae40594d20aacb9446919f8cc9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:48.031157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.031442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.031765 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.062009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:48.071146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.080981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c47d-6f92-48d2-9fec-39ced7377c08 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.151205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:48.217130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.218428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.218804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.219095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.219819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.225776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:48.236884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 924/1863] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:48.237938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.239327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.259032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe482fbe-5e16-464a-9080-baa915466658 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.266306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 940/1864] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:47 2022] POST /identity/v3/users => generated 294 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:48.267153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.268932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.273901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.274807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.275133 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.275464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] PATH_INFO: `/v3/projects/294ec837450b46c480268a312a76cf37` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.277014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=294ec837450b46c480268a312a76cf37)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.279510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:48.283593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6917e-fba2-4d96-8229-e002ea657b43 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.289326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.290198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.290479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.290782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] PATH_INFO: `/v3/projects/92ae47f264b74177bf26962ce61847f7` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.292149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ae47f264b74177bf26962ce61847f7)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.294160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:48.331147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:48.352880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294ec837450b46c480268a312a76cf37', 'request_id': 'req-186f08ee-7e8b-4453-88a0-f88d87a3e20b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.359812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294ec837450b46c480268a312a76cf37', 'request_id': 'req-186f08ee-7e8b-4453-88a0-f88d87a3e20b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.370569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294ec837450b46c480268a312a76cf37', 'request_id': 'req-186f08ee-7e8b-4453-88a0-f88d87a3e20b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.389804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] The token cache is being invalidate because project 294ec837450b46c480268a312a76cf37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:48.390637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.391764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-186f08ee-7e8b-4453-88a0-f88d87a3e20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.392876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ae47f264b74177bf26962ce61847f7', 'request_id': 'req-ba3ab86f-d169-431b-8d8c-a6df9865fa42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.394097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 925/1865] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:48 2022] DELETE /identity/v3/projects/294ec837450b46c480268a312a76cf37 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:48.396303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df973c-9121-4f96-8fea-88851aa36cb8 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.396698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df973c-9121-4f96-8fea-88851aa36cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.397257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df973c-9121-4f96-8fea-88851aa36cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.406397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ae47f264b74177bf26962ce61847f7', 'request_id': 'req-ba3ab86f-d169-431b-8d8c-a6df9865fa42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.432172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ae47f264b74177bf26962ce61847f7', 'request_id': 'req-ba3ab86f-d169-431b-8d8c-a6df9865fa42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.459110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-13df973c-9121-4f96-8fea-88851aa36cb8 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:48.463187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-13df973c-9121-4f96-8fea-88851aa36cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.473323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] The token cache is being invalidate because project 92ae47f264b74177bf26962ce61847f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:48.473628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.474653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:48.478709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 941/1866] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:48 2022] DELETE /identity/v3/projects/92ae47f264b74177bf26962ce61847f7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:48.480704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.484051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.621355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 926/1867] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:48.622759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4844678-2d94-4a1d-9aed-e2b241a8c6f5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.623056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4844678-2d94-4a1d-9aed-e2b241a8c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.623500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4844678-2d94-4a1d-9aed-e2b241a8c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.666903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a4844678-2d94-4a1d-9aed-e2b241a8c6f5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:48.669068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a4844678-2d94-4a1d-9aed-e2b241a8c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.696834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab86f-d169-431b-8d8c-a6df9865fa42 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.704398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 927/1868] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:48.706149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a876-002a-46ca-b6ea-1371a339f687 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.706669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a876-002a-46ca-b6ea-1371a339f687 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.707541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a876-002a-46ca-b6ea-1371a339f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.714878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.716012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.716296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.716576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.717477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.721878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:48.749308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 942/1869] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:48.750329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.760841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-cfb1a876-002a-46ca-b6ea-1371a339f687 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:48.763183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cfb1a876-002a-46ca-b6ea-1371a339f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.780112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294364-8971-415b-8c5d-9dec1c5f6d37 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.793163 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.794054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.794375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.794818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.795800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:48.796121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.799276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 928/1870] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:48.800506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:48.804979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.805856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.806947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.836510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 943/1871] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:48.837662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.861718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57d85-91a0-4830-9629-66cfc5b18fdf admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.876806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1819508-c38e-4de3-bfe2-879db214f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.877675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1819508-c38e-4de3-bfe2-879db214f98d admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.879563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1819508-c38e-4de3-bfe2-879db214f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.879563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1819508-c38e-4de3-bfe2-879db214f98d admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.879563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1819508-c38e-4de3-bfe2-879db214f98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.881286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1819508-c38e-4de3-bfe2-879db214f98d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:48.903373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:48.907834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 944/1872] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:48.910097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.910498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.910643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.911021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.952445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:48.953717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:48.957539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 929/1873] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:48.958498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.975835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 945/1874] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:48.976698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:48.977562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7f13c-b63b-4358-8663-d17fbed817aa None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:48.988252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:48.992795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:48.993090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:48.993385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:48.995550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:48.998815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39dffb-1205-471e-9be0-40bd25ce2415 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.006279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.012463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:49.013431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.014088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.014088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] PATH_INFO: `/v3/projects/c95af2cb79cb402cb41bb4ea4c741bf9/users/b7286e4561a74e018d8b3aa12b631a98/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.025619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:49.073796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95af2cb79cb402cb41bb4ea4c741bf9, user_id=b7286e4561a74e018d8b3aa12b631a98, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:49.089770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.104108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 930/1875] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:48 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:49.105853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:49.124094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 946/1876] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:48 2022] PUT /identity/v3/projects/c95af2cb79cb402cb41bb4ea4c741bf9/users/b7286e4561a74e018d8b3aa12b631a98/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:49.125338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:49.353460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a890f3-1cea-425b-b7b9-99faacf57217 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.450033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810dfcb-f2a8-4cef-9eec-29510f9ffeca admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.472060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:49.473431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.474167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.474856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.476663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:49.480058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:49.481101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:49.493269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.552996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 947/1877] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:49.554632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:49.587506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:49.590293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.592560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.592999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.602551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:49.602551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:49.602551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636216af-b9d8-4822-aa1d-ab1916417db3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.629086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693a68d-664e-44d9-bcfc-bb683e478a87 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.645659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 931/1878] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:49.649119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:49.650589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.650831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.651249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.652279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.652585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:49.654149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.654345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.665083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.721576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 948/1879] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:49 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:49.724760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:49.735416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] MFA Rules not processed for user `b7286e4561a74e018d8b3aa12b631a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:49.736855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:49.748181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b1d2-dbbd-4ad2-889b-97e6cf185a48 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.760723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:49.761408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.761691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.761991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.762663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:49.768210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.835258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 949/1880] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:49 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:49.837018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:49.877219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 932/1881] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:49.878913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:49.903534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14d98-866c-433f-bcd2-e0a9a8589933 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.954614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43e6dd-0c3e-46ae-b9c1-84aa83cda748 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:49.960307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:49.961054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:49.961378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:49.961649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:49.962349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:49.964781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:49.999544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.000276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.000567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.000831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.001568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.002301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 950/1882] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:49 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:50.003136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.003461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.016750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 933/1883] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.017621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.029120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88052b79-7721-4b00-911a-1e0d76210e42 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.039663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:50.087339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1dc32-b122-492e-b18a-947da2992672 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.087549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:50.093786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.094517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.094804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.095085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.095848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.097892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.100604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.101278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.101797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.101797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.102503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.104493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.121251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 951/1884] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:50 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:50.122075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.132849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1732bd-b873-497b-954a-645fa096648c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.140926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 934/1885] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:50 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:50.140926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.147405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.148152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.148660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.149031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.149959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.152810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.186853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 952/1886] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:50 2022] POST /identity/v3/users => generated 286 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:50.187826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.201734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd2a7-e3ca-4d09-92b9-534368e6e88f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.274473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0dff-6d8d-47ca-a965-ccef7289d274 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.283944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.284726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.285084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.285439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.286268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.288760 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.302833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 935/1887] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.305126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.318634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798d441-f763-4f23-99bd-0405ce5d16f0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.321379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.322774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.323391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.324605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.324801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.325496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.325869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.326117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.326273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.327011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.329161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.329304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.348645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 953/1888] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.352628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.364751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 936/1889] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:50 2022] POST /identity/v3/users => generated 300 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:50.364751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.365255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02b13-1ea7-43bd-9f6d-81f1b1e8b1e5 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.383363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.384267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.384553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.384831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.385343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71743-c572-4ae8-a4fb-97ed6e0cacbb admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.385604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.387272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.391312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.392493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.392861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.393153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] PATH_INFO: `/v3/projects/e84bc4d58261452dab06f78277f051a3/users/81c14c0437964419ad68d234716a1b1e/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.403182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 954/1890] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.403182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.412286 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84bc4d58261452dab06f78277f051a3, user_id=81c14c0437964419ad68d234716a1b1e, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.413698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52600c3-ea61-4d7e-8445-ee87465ac334 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.415777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.418884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.419607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.419923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.420451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.421066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.422905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.433993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 937/1891] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:50 2022] PUT /identity/v3/projects/e84bc4d58261452dab06f78277f051a3/users/81c14c0437964419ad68d234716a1b1e/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:50.437090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.440770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 955/1892] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.442482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.461198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d398-2d8c-4f2b-903f-c0fca64387cc admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.523120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267060c1-055c-45cb-b5c6-e0c517f99d83 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.526752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ac965-6c5c-4bf5-8cac-3013b9d234aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.527427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac965-6c5c-4bf5-8cac-3013b9d234aa admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.527737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac965-6c5c-4bf5-8cac-3013b9d234aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.528016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac965-6c5c-4bf5-8cac-3013b9d234aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.528750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ac965-6c5c-4bf5-8cac-3013b9d234aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.530369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ac965-6c5c-4bf5-8cac-3013b9d234aa admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.530722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.531929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.532461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.532942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.533983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.537317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.541373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 956/1893] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.542774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.542981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.543262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.550249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:50.562972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 938/1894] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:50.564481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.581401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] MFA Rules not processed for user `81c14c0437964419ad68d234716a1b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:50.582734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:50.583953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df18d75-7a74-42d3-8f58-9cf49c5213e3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.601679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.606009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.606009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.606009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] PATH_INFO: `/v3/projects/9fc02cbb3c9b4d1290e0e8ddbab94e99/users/4b3a55330cf649c3bcc3db697a90f294/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.660114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc02cbb3c9b4d1290e0e8ddbab94e99, user_id=4b3a55330cf649c3bcc3db697a90f294, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.667792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.718672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 939/1895] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:50 2022] PUT /identity/v3/projects/9fc02cbb3c9b4d1290e0e8ddbab94e99/users/4b3a55330cf649c3bcc3db697a90f294/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:50.737822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.750530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:50.800234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 957/1896] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:50.801214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:50.824559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34656a3-cbb5-482d-89d3-2fc7da29bbb6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.875546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f0aa2-ac8c-4a3d-baf8-4218bc0d39c2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:50.883447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79f33-0aab-412e-b25e-85bdc456e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.883954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79f33-0aab-412e-b25e-85bdc456e1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.884240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79f33-0aab-412e-b25e-85bdc456e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.884522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79f33-0aab-412e-b25e-85bdc456e1d5 admin admin] PATH_INFO: `/v3/projects/306da236ef944ce6ae28625a82227434/users/125b3386b7594762bad12c5b43123e2f/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.934894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79f33-0aab-412e-b25e-85bdc456e1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306da236ef944ce6ae28625a82227434, user_id=125b3386b7594762bad12c5b43123e2f, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:50.945301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79f33-0aab-412e-b25e-85bdc456e1d5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:50.951319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:50.953971 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.953971 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.956585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] PATH_INFO: `/v3/projects/582c396ce2af4db693dd6e36579e4d3e/users/9ce8ea5de68848b8bc8d7f940df317f0/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:50.980886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 940/1897] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:50 2022] PUT /identity/v3/projects/306da236ef944ce6ae28625a82227434/users/125b3386b7594762bad12c5b43123e2f/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:50.984190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:50.985111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:50.986104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.009887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582c396ce2af4db693dd6e36579e4d3e, user_id=9ce8ea5de68848b8bc8d7f940df317f0, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.022837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:51.061122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 958/1898] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:50 2022] PUT /identity/v3/projects/582c396ce2af4db693dd6e36579e4d3e/users/9ce8ea5de68848b8bc8d7f940df317f0/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:51.062018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.090761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] MFA Rules not processed for user `4b3a55330cf649c3bcc3db697a90f294`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:51.095312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:51.201291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc674-8d12-4daa-9368-8fa9666b2667 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:51.215668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6265b5-a356-440b-8bbc-36a7a5c31e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:51.218665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6265b5-a356-440b-8bbc-36a7a5c31e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.218963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6265b5-a356-440b-8bbc-36a7a5c31e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.219252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6265b5-a356-440b-8bbc-36a7a5c31e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.223104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6265b5-a356-440b-8bbc-36a7a5c31e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.226325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6265b5-a356-440b-8bbc-36a7a5c31e00 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:51.301272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 959/1899] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:51 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:51.301272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.301272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.301272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.316863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:51.366552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 941/1900] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:51.368211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.373714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] MFA Rules not processed for user `125b3386b7594762bad12c5b43123e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:51.375439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:51.389413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bace5-2619-4cda-b929-ad27dcf8161f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:51.479196 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 960/1901] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:51.483234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.563591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:51.566565 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.568536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.569958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.571587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.577539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:51.630663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 942/1902] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:51.630663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.655548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728421e8-6a5b-4041-b966-d94dd3b1e2b6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:51.661102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:51.661789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.662068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.662453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.663180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.666045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:51.667530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ceff4-11c1-4c10-9a15-3a61367fa367 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:51.676515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:51.679857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:51.681200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.681685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.682359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.683706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.687546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:51.703499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 943/1903] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:51 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:51.704569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.706476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:51.738787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 961/1904] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:51 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:51.740335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.769583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382ef6-6c0d-4fb7-8cba-33e8aafce54d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:51.777535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1de6d-d039-48ee-b233-95a9bc1408cd admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:51.782386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:51.783657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.783838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.784192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.884036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.885674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:51.898480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 944/1905] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:51.899167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:51.980746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:51.982494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:51.982927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:51.983331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] PATH_INFO: `/v3/projects/582c396ce2af4db693dd6e36579e4d3e/users/9ce8ea5de68848b8bc8d7f940df317f0/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:51.986467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=582c396ce2af4db693dd6e36579e4d3e, user_id=9ce8ea5de68848b8bc8d7f940df317f0, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:51.989601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.013317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 962/1906] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:51 2022] PUT /identity/v3/projects/582c396ce2af4db693dd6e36579e4d3e/users/9ce8ea5de68848b8bc8d7f940df317f0/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:52.015004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.040078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:52.078281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e701-fa66-494c-8e4c-93577af55dce service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.114325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c7b1-5ec7-47d6-95b6-913d4f3212fe admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.125444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.126563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.127343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.128992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.130489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.133034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.158667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 963/1907] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:52.160087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.195003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d911d9-c89a-4cbb-af78-f96e9b652b63 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.204097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.205532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.206037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.206534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] PATH_INFO: `/v3/users/125b3386b7594762bad12c5b43123e2f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.208766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125b3386b7594762bad12c5b43123e2f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.212668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.218146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:52.241191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c997d1-92f5-464d-9081-056c37adf73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.242380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c997d1-92f5-464d-9081-056c37adf73e admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.242870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c997d1-92f5-464d-9081-056c37adf73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.244111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c997d1-92f5-464d-9081-056c37adf73e admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.245547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c997d1-92f5-464d-9081-056c37adf73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.249381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c997d1-92f5-464d-9081-056c37adf73e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.307956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 945/1908] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:51 2022] POST /identity/v3/users => generated 296 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:52.311486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.312066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.312568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.314146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125b3386b7594762bad12c5b43123e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:52.315029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125b3386b7594762bad12c5b43123e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:52.330412 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125b3386b7594762bad12c5b43123e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:52.354616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] MFA Rules not processed for user `9ce8ea5de68848b8bc8d7f940df317f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:52.357281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:52.372957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125b3386b7594762bad12c5b43123e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:52.373912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125b3386b7594762bad12c5b43123e2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:52.408989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 964/1909] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:52 2022] DELETE /identity/v3/users/125b3386b7594762bad12c5b43123e2f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:52.410429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.414664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:52.494875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 946/1910] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:52.500377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.506981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:52.520391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc9b4-d1e7-41f2-a5d8-77e237b4e109 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.521784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2573-6595-4732-b6ab-c401a1b6b5be None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.527036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.527174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043067cf-e5aa-4397-b001-381cd127d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.527925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043067cf-e5aa-4397-b001-381cd127d0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.528040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.528218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.528309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043067cf-e5aa-4397-b001-381cd127d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.528486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] PATH_INFO: `/v3/projects/d4977a4e1f3c4de394cb81fb70033f77/users/a4cf655b98374c1b9e8b5ecc7987fc46/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.528749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043067cf-e5aa-4397-b001-381cd127d0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.529465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043067cf-e5aa-4397-b001-381cd127d0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.531149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043067cf-e5aa-4397-b001-381cd127d0f8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.542970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 947/1911] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:52.544389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.544684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.544965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.548418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4977a4e1f3c4de394cb81fb70033f77, user_id=a4cf655b98374c1b9e8b5ecc7987fc46, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.552841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.564823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:52.566325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:52.568509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 965/1912] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:52 2022] PUT /identity/v3/projects/d4977a4e1f3c4de394cb81fb70033f77/users/a4cf655b98374c1b9e8b5ecc7987fc46/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:52.569183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.570836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:52.580640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:52.643835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 948/1913] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:52.643835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.652192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39080-4787-4d3a-9ad7-73096534a43c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.652378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32151897-5f0e-4912-a31c-56102ecf3e64 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.656181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.656937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.657288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.657399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.657689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.658238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.658559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.658850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] PATH_INFO: `/v3/projects/64d43f3b1af045c593d32395e2cb8697/users/2936824e93cd4e1e97125fe77981f733/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.678080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d43f3b1af045c593d32395e2cb8697, user_id=2936824e93cd4e1e97125fe77981f733, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.681043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.699817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 949/1914] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:52 2022] PUT /identity/v3/projects/64d43f3b1af045c593d32395e2cb8697/users/2936824e93cd4e1e97125fe77981f733/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:52.700796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.727011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.728513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.739114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:52.739572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 966/1915] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:52.740454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.743091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:52.795387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a9b3f-c427-429f-96a1-59c3e8e7f1cc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.810935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.811655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.812014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.812208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.812961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.814616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.828676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 950/1916] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:52.830126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.843237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1e13-afeb-44ee-8d9b-2de986549365 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.851549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.852960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.854908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4314fe1-347c-434d-9737-1c901e371894 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.858382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.858382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.862700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.864552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.885128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 951/1917] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:52.885128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.905729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1183-ed21-4200-950a-f792e33a663d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:52.937205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.937205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.937205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.937205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] PATH_INFO: `/v3/projects/d4977a4e1f3c4de394cb81fb70033f77/users/a4cf655b98374c1b9e8b5ecc7987fc46/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.937619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4977a4e1f3c4de394cb81fb70033f77, user_id=a4cf655b98374c1b9e8b5ecc7987fc46, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.938082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.947974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfea6ab-ece9-4db3-8512-3abdce0cddf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:52.949074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea6ab-ece9-4db3-8512-3abdce0cddf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:52.949624 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea6ab-ece9-4db3-8512-3abdce0cddf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:52.950058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea6ab-ece9-4db3-8512-3abdce0cddf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:52.954086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 952/1918] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:52 2022] PUT /identity/v3/projects/d4977a4e1f3c4de394cb81fb70033f77/users/a4cf655b98374c1b9e8b5ecc7987fc46/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:52.956240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:52.964510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea6ab-ece9-4db3-8512-3abdce0cddf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:52.968004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea6ab-ece9-4db3-8512-3abdce0cddf6 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:52.995609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 967/1919] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:52.999263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.000753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.001441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.054939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] MFA Rules not processed for user `a4cf655b98374c1b9e8b5ecc7987fc46`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:53.056580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:53.069839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:53.070723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf5e49-fb37-467b-b5a7-1f49130dbdb4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:53.079740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab261a-aae1-4c11-a678-67230017c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:53.081557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab261a-aae1-4c11-a678-67230017c75a admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.082024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab261a-aae1-4c11-a678-67230017c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.082823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab261a-aae1-4c11-a678-67230017c75a admin admin] PATH_INFO: `/v3/projects/64d43f3b1af045c593d32395e2cb8697/users/2936824e93cd4e1e97125fe77981f733/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.086494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab261a-aae1-4c11-a678-67230017c75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d43f3b1af045c593d32395e2cb8697, user_id=2936824e93cd4e1e97125fe77981f733, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:53.090061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab261a-aae1-4c11-a678-67230017c75a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:53.115877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 953/1920] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:52 2022] PUT /identity/v3/projects/64d43f3b1af045c593d32395e2cb8697/users/2936824e93cd4e1e97125fe77981f733/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:53.129987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.130556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.131012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.176605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] MFA Rules not processed for user `2936824e93cd4e1e97125fe77981f733`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:53.179509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:53.180765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 968/1921] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:53.223976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:53.225710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:53.286434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 954/1922] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:53.351947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f843490-082e-41cb-a34e-1b36ed25705b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:53.427941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:53.429663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.430323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.431028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.433690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:53.437501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:53.438878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:53.522676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:53.549502 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:53.553829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:53.572693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 969/1923] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:33:53.573991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:53.588484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef83e2-7f68-413f-83c0-4606f9ed42fd service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:53.593882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d8878-942a-464f-835b-48f740464ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:53.595470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d8878-942a-464f-835b-48f740464ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.596095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d8878-942a-464f-835b-48f740464ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.596590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d8878-942a-464f-835b-48f740464ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.614346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d8878-942a-464f-835b-48f740464ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:53.615131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb340c77-a037-4e85-bcb4-87b904ec695e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:53.617682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d8878-942a-464f-835b-48f740464ed3 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:53.626316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:53.630088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:53.631215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.631753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.632161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] PATH_INFO: `/v3/projects/306da236ef944ce6ae28625a82227434` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.640030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306da236ef944ce6ae28625a82227434)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:53.641985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 970/1924] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:53.642148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:53.752380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306da236ef944ce6ae28625a82227434', 'request_id': 'req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:53.763551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306da236ef944ce6ae28625a82227434', 'request_id': 'req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:53.773331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306da236ef944ce6ae28625a82227434', 'request_id': 'req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:53.800632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] The token cache is being invalidate because project 306da236ef944ce6ae28625a82227434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:53.801001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:53.801658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eeb76440-cfc1-49a8-8ac5-83d78b8e5575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:53.804192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 955/1925] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:53 2022] DELETE /identity/v3/projects/306da236ef944ce6ae28625a82227434 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:53.809127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.809402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.809815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:53.833620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:53.835115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:53.990080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 971/1926] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:53.998825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:53.999151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:53.999503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.020388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:54.022254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:54.035270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 956/1927] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:54.036286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.048348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761cd09-03d3-453b-95a0-cac406713d86 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.055107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.055846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.056788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.057415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.058133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:54.058447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.060227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.083288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 972/1928] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:33:54.089317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.103164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73969d-d313-419f-b6cf-30b18a59b0d4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.119463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.120401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.121086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.121806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.122621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.130798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.189351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 957/1929] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:54 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:54.195552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.209781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c3d6-310a-436f-b34d-a639f6924f2b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.312704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.313400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.313683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.313969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.314662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.316727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.343323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 973/1930] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:54 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:54.348365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.362796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84135360-cfc3-42c1-b28a-834c0ff32215 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.372471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.374498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:54.374863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.375959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.376475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.377137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.378295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.380426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.390687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5448e-8d36-4b17-b277-42e3486b2b52 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.395918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 958/1931] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:33:54.401895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.402668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.402857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.402977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.403282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] PATH_INFO: `/v3/users/b7286e4561a74e018d8b3aa12b631a98` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.404954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7286e4561a74e018d8b3aa12b631a98)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.407472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.418298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdbc7c-302f-4bdc-a1ae-14e2914fede3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.427441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.428764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.429248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.429735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.430583 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.433318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.451890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 959/1932] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:54.460839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.483309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181235d6-e074-4e96-92d1-5ca7274b3c16 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.491789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7286e4561a74e018d8b3aa12b631a98'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:54.492742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7286e4561a74e018d8b3aa12b631a98'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:54.497016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.497960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.498265 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.498545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] PATH_INFO: `/v3/projects/ddbce0677e62440a90b0fff420760512/users/6df5eff214c74326842044cb745ee062/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.511243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7286e4561a74e018d8b3aa12b631a98'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:54.529874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:54.531292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbce0677e62440a90b0fff420760512, user_id=6df5eff214c74326842044cb745ee062, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.532415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7286e4561a74e018d8b3aa12b631a98'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:54.535031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8e2e8b26-ce50-4c59-9eb4-3d31940bf5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7286e4561a74e018d8b3aa12b631a98'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:54.535414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.554790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 960/1933] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:54 2022] PUT /identity/v3/projects/ddbce0677e62440a90b0fff420760512/users/6df5eff214c74326842044cb745ee062/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:54.555729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.556613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 974/1934] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:54 2022] DELETE /identity/v3/users/b7286e4561a74e018d8b3aa12b631a98 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:54.557437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:54.561203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a44db-f3c2-4f57-90f1-235fe25c2562 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.561742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a44db-f3c2-4f57-90f1-235fe25c2562 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.562293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a44db-f3c2-4f57-90f1-235fe25c2562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.584162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4c4a44db-f3c2-4f57-90f1-235fe25c2562 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:54.586087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4c4a44db-f3c2-4f57-90f1-235fe25c2562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:54.613208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:54.649155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1cd48-d631-421e-9cc1-671d42158c83 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.672873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 975/1935] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:54.677357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.677784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.678616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.742531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] MFA Rules not processed for user `6df5eff214c74326842044cb745ee062`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:54.744226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:54.812252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2936824e93cd4e1e97125fe77981f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d43f3b1af045c593d32395e2cb8697', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.815701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.816098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.819436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.821904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:54.822492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:54.830713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:54.892627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 961/1936] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:54.893921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.898912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:54.909741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 976/1937] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:54.910859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:54.953965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f885a-8cce-4fac-8f20-3c280a16b489 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:54.989948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2936824e93cd4e1e97125fe77981f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d43f3b1af045c593d32395e2cb8697', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:54.991395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:54.991842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:54.992220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:54.993167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:55.006400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:55.052361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a01d-a6d1-4aac-87ed-f0b6d938191f tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:55.065242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:55.077588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:55.079466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:55.080313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:55.119033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:55.123181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 977/1938] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:54 2022] POST /identity/v3/projects => generated 355 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:55.124214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:55.126257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:55.128891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:55.167922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 962/1939] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:55.168851 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:55.203914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d05b-d72f-4a61-a4d9-8257b8893aee service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:55.341080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d91e8-31af-4b39-8a2f-23a65875ca46 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:55.355924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:55.356700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:55.357900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:55.359112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:55.405635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:55.412997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2936824e93cd4e1e97125fe77981f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d43f3b1af045c593d32395e2cb8697', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:55.413821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:55.414109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:55.414534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:55.415165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:55.415546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:55.417441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:55.448991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 963/1940] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:33:55.547073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:55.549995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:55.565784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 978/1941] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:55.664028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:55.681098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17729ef5-3f48-4887-8135-56baecf7dbd8 tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:55.692645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2936824e93cd4e1e97125fe77981f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d43f3b1af045c593d32395e2cb8697', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:55.694641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:55.695771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:55.697478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] PATH_INFO: `/v3/projects/e24f1506d303493288bfc04fdd75cbd0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:55.700568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e24f1506d303493288bfc04fdd75cbd0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:55.703441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:55.743668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:55.745901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:55.747786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:55.770452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ea37-afda-4186-9dd2-29ebf7d9fc7d service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:55.779406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:55.780107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:55.780392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:55.780671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:55.783484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:55.817324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24f1506d303493288bfc04fdd75cbd0', 'request_id': 'req-975e74bc-9485-4685-b9a6-eb155597cb8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:55.831227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24f1506d303493288bfc04fdd75cbd0', 'request_id': 'req-975e74bc-9485-4685-b9a6-eb155597cb8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:55.843094 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24f1506d303493288bfc04fdd75cbd0', 'request_id': 'req-975e74bc-9485-4685-b9a6-eb155597cb8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:55.861407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] The token cache is being invalidate because project e24f1506d303493288bfc04fdd75cbd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:55.861513 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:55.864176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:55.870467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 964/1942] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:55 2022] DELETE /identity/v3/projects/e24f1506d303493288bfc04fdd75cbd0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:55.899821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:55.901591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:55.913002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 979/1943] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:55.946338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:55.947989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:56.094164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e74bc-9485-4685-b9a6-eb155597cb8b tempest-VolumeQuotaClassesTest-805635243 tempest-VolumeQuotaClassesTest-805635243-project-admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:56.109375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:56.110521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:56.110521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:56.110870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] PATH_INFO: `/v3/projects/c95af2cb79cb402cb41bb4ea4c741bf9` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:56.112128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95af2cb79cb402cb41bb4ea4c741bf9)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:56.114150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:56.216209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95af2cb79cb402cb41bb4ea4c741bf9', 'request_id': 'req-de29b16b-2be5-4762-9724-1f07fefb66ef'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.222925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95af2cb79cb402cb41bb4ea4c741bf9', 'request_id': 'req-de29b16b-2be5-4762-9724-1f07fefb66ef'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.230540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95af2cb79cb402cb41bb4ea4c741bf9', 'request_id': 'req-de29b16b-2be5-4762-9724-1f07fefb66ef'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.270054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] The token cache is being invalidate because project c95af2cb79cb402cb41bb4ea4c741bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:56.271340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.272787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.277227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 965/1944] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:55 2022] DELETE /identity/v3/projects/c95af2cb79cb402cb41bb4ea4c741bf9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:56.281360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:56.288853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:56.366091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:56.367794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:56.436663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:56.453741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc692ef-6d36-439d-b61a-ce7227b3e3ce service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:56.491514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b16b-2be5-4762-9724-1f07fefb66ef admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:56.496388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:56.497424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:56.497773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:56.498058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] PATH_INFO: `/v3/users/4b3a55330cf649c3bcc3db697a90f294` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:56.499343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3a55330cf649c3bcc3db697a90f294)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:56.501336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:56.525062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:56.536863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:56.538373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:56.538625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:56.538896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] PATH_INFO: `/v3/users/9ce8ea5de68848b8bc8d7f940df317f0` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:56.540456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce8ea5de68848b8bc8d7f940df317f0)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:56.542615 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:56.557901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3a55330cf649c3bcc3db697a90f294'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.558577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3a55330cf649c3bcc3db697a90f294'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.568640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3a55330cf649c3bcc3db697a90f294'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.583752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3a55330cf649c3bcc3db697a90f294'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.592355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-00730c14-2562-4ce9-bb43-8c72a9880c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3a55330cf649c3bcc3db697a90f294'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.598102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce8ea5de68848b8bc8d7f940df317f0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.598950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce8ea5de68848b8bc8d7f940df317f0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.604343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 966/1945] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:56 2022] DELETE /identity/v3/users/4b3a55330cf649c3bcc3db697a90f294 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:33:56.605725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:56.606004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:56.606353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:56.612679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce8ea5de68848b8bc8d7f940df317f0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.627254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:56.627733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:56.629264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce8ea5de68848b8bc8d7f940df317f0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.629952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce8ea5de68848b8bc8d7f940df317f0'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:56.645986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 980/1946] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:56 2022] DELETE /identity/v3/users/9ce8ea5de68848b8bc8d7f940df317f0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:56.698073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 967/1947] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:33:56.709208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:56.710818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:56.786120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ca01-dd46-456b-9378-8865671a4813 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:56.791211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f218-dc6e-4907-995e-0d0ab4e45d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:56.792013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f218-dc6e-4907-995e-0d0ab4e45d11 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:56.792299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f218-dc6e-4907-995e-0d0ab4e45d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:56.792604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f218-dc6e-4907-995e-0d0ab4e45d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:56.862559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f218-dc6e-4907-995e-0d0ab4e45d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:56.864111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f218-dc6e-4907-995e-0d0ab4e45d11 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:56.876011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 981/1948] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:57.177101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:57.178488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:57.199473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d43f7-50af-40d8-b80b-cc2c6d459d7a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:57.205743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:57.207539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.208246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.208894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] PATH_INFO: `/v3/projects/582c396ce2af4db693dd6e36579e4d3e` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.210894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] RBAC: Authorizing `identity:delete_project(project_id=582c396ce2af4db693dd6e36579e4d3e)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:57.213214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:57.286682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:57.293312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582c396ce2af4db693dd6e36579e4d3e', 'request_id': 'req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.301039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582c396ce2af4db693dd6e36579e4d3e', 'request_id': 'req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.312863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582c396ce2af4db693dd6e36579e4d3e', 'request_id': 'req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.330903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] The token cache is being invalidate because project 582c396ce2af4db693dd6e36579e4d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:57.331906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.332773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.338708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 968/1949] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:57 2022] DELETE /identity/v3/projects/582c396ce2af4db693dd6e36579e4d3e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:57.344276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e9f6-f482-493f-a798-535e7f582046 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.344747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e9f6-f482-493f-a798-535e7f582046 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.344836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e9f6-f482-493f-a798-535e7f582046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.377781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5f53e9f6-f482-493f-a798-535e7f582046 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:57.379052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5f53e9f6-f482-493f-a798-535e7f582046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:57.384871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:57.386509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:57.402276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:57.501667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb9c68-3e0a-49db-a02d-26ed9ed1312d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:57.514926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:57.515923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.516240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.516482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] PATH_INFO: `/v3/projects/9fc02cbb3c9b4d1290e0e8ddbab94e99` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.519734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc02cbb3c9b4d1290e0e8ddbab94e99)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:57.520545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:57.559290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 982/1950] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:57.574098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.574488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.575120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.622715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:57.624298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:57.668610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc02cbb3c9b4d1290e0e8ddbab94e99', 'request_id': 'req-2029086c-05a5-4856-88f0-51a59ff1769a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.682230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc02cbb3c9b4d1290e0e8ddbab94e99', 'request_id': 'req-2029086c-05a5-4856-88f0-51a59ff1769a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.702781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc02cbb3c9b4d1290e0e8ddbab94e99', 'request_id': 'req-2029086c-05a5-4856-88f0-51a59ff1769a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.750627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] The token cache is being invalidate because project 9fc02cbb3c9b4d1290e0e8ddbab94e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:57.750944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.753079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:57.755669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 969/1951] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:57 2022] DELETE /identity/v3/projects/9fc02cbb3c9b4d1290e0e8ddbab94e99 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:57.760541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:57.763048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:57.800393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 983/1952] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:57.805807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:57.835903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc2e5-68b9-4600-b1bf-237e3c46f6be None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:57.845940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:57.846812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.847252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.847722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.849046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:33:57.851139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:57.853164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:57.884691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 984/1953] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:33:57.885974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:57.904512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029086c-05a5-4856-88f0-51a59ff1769a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:57.916737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:57.917811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ae05a-5e59-4fee-87ab-6981adae299c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:57.917932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.918185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.918471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] PATH_INFO: `/v3/users/2936824e93cd4e1e97125fe77981f733` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.922914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:57.923314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2936824e93cd4e1e97125fe77981f733)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:57.923601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:57.923926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:57.924206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:57.924965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:57.925330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:57.938604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:57.938831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:57.965945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 985/1954] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:33:57 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:57.966870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:58.035120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2936824e93cd4e1e97125fe77981f733'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:58.036086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2936824e93cd4e1e97125fe77981f733'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:58.047234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2936824e93cd4e1e97125fe77981f733'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:58.077434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2936824e93cd4e1e97125fe77981f733'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:58.086611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f783-cf63-41ec-ba98-1122d4a4cf3e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:58.089897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2936824e93cd4e1e97125fe77981f733'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:58.094237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:58.094957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.095248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.095642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.096720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:58.099132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:58.111442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 970/1955] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:57 2022] DELETE /identity/v3/users/2936824e93cd4e1e97125fe77981f733 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:58.133418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 986/1956] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:33:57 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:33:58.137412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:58.139179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:58.316161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bd955-48b7-4e30-a169-cdcef976483c admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:58.326348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:58.327858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.328145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.328476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.329226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:58.335807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:58.364158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 971/1957] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:58.369386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:58.386973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c546c1-8283-47a4-8c25-882d5cabede0 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:58.392952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fafa9b-4dd5-48da-940e-63761d62c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:58.393712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fafa9b-4dd5-48da-940e-63761d62c57d admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.394142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fafa9b-4dd5-48da-940e-63761d62c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.394291 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fafa9b-4dd5-48da-940e-63761d62c57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.395495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fafa9b-4dd5-48da-940e-63761d62c57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:58.398077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fafa9b-4dd5-48da-940e-63761d62c57d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:58.411442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 987/1958] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:33:58.416577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:58.431786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea5940-4f32-4e3c-8cfe-d5933479aa71 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:58.456808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:58.480060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.480777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.481275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] PATH_INFO: `/v3/projects/cfd3080e7d454b5b90b9187576fc96cf/users/5cf5cbd741e74bc0941c9d7b535fd979/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.501110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3080e7d454b5b90b9187576fc96cf, user_id=5cf5cbd741e74bc0941c9d7b535fd979, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:58.505306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:58.532590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 972/1959] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:33:58 2022] PUT /identity/v3/projects/cfd3080e7d454b5b90b9187576fc96cf/users/5cf5cbd741e74bc0941c9d7b535fd979/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:58.544902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.545196 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.545726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.552704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:58.576005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] MFA Rules not processed for user `5cf5cbd741e74bc0941c9d7b535fd979`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:58.577243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:58.704958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:58.706707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 988/1960] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:58.708134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:58.748255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:58.750972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:58.832063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8a818-fe0d-4d62-bcfc-8e5eda409a2d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:58.839231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9ae1-4c7f-499e-b98a-77610982972e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:58.840204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9ae1-4c7f-499e-b98a-77610982972e service glance] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.840585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9ae1-4c7f-499e-b98a-77610982972e service glance] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.840873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9ae1-4c7f-499e-b98a-77610982972e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.853627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:58.857648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9ae1-4c7f-499e-b98a-77610982972e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:58.861325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9ae1-4c7f-499e-b98a-77610982972e service glance] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:58.876878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cf6c0-1e72-4721-b37b-bf0ef2d884a8 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:58.879578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 973/1961] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:58.887150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:58.888101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:58.888456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:58.888889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] PATH_INFO: `/v3/users/6df5eff214c74326842044cb745ee062` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:58.895751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df5eff214c74326842044cb745ee062)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:58.895751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:58.997126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df5eff214c74326842044cb745ee062'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.007390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df5eff214c74326842044cb745ee062'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.037944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df5eff214c74326842044cb745ee062'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.082045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df5eff214c74326842044cb745ee062'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.083108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df5eff214c74326842044cb745ee062'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.107845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 989/1962] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:58 2022] DELETE /identity/v3/users/6df5eff214c74326842044cb745ee062 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:59.110165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:59.110808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:59.111138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:59.141062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:59.143185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:59.254869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 974/1963] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:33:59.297959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:59.299754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:59.342002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:59.343883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:33:59.346403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:59.370880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969976a8-c057-4e45-8dad-7efa1f01ca00 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:59.376727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:59.377653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:59.378601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:59.378907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] PATH_INFO: `/v3/users/74f6d398a8434677b9a60c3754be083d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:59.380543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f6d398a8434677b9a60c3754be083d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:59.383602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:59.455772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2ffec-9b99-44db-8147-0de9168b95f7 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:59.466312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:59.467144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:59.467431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:59.467800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:59.492011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f6d398a8434677b9a60c3754be083d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.493162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f6d398a8434677b9a60c3754be083d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.503572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:59.507389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:59.512461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f6d398a8434677b9a60c3754be083d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.539961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 990/1964] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:33:59.541182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:33:59.545740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:33:59.577064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49c87-4ea6-4ae8-99a5-c060c8902194 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:33:59.577196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f6d398a8434677b9a60c3754be083d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.586519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:33:59.594684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:59.595015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:59.595310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] PATH_INFO: `/v3/projects/64d43f3b1af045c593d32395e2cb8697` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:59.600401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d43f3b1af045c593d32395e2cb8697)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:33:59.607999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ae94fcab-9ed3-4404-a722-8b0eece92a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f6d398a8434677b9a60c3754be083d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.608513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:33:59.636557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 975/1965] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:33:59 2022] DELETE /identity/v3/users/74f6d398a8434677b9a60c3754be083d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:59.726448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d43f3b1af045c593d32395e2cb8697', 'request_id': 'req-ea613718-eec5-4194-bfdf-fe5431c66f81'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.751108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d43f3b1af045c593d32395e2cb8697', 'request_id': 'req-ea613718-eec5-4194-bfdf-fe5431c66f81'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.775303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d43f3b1af045c593d32395e2cb8697', 'request_id': 'req-ea613718-eec5-4194-bfdf-fe5431c66f81'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.807294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] The token cache is being invalidate because project 64d43f3b1af045c593d32395e2cb8697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:33:59.807756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.808761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ea613718-eec5-4194-bfdf-fe5431c66f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:33:59.816911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 991/1966] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:33:59 2022] DELETE /identity/v3/projects/64d43f3b1af045c593d32395e2cb8697 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:33:59.819914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:33:59.820319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:33:59.820778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:33:59.866940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:33:59.868496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.039037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 976/1967] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:00.047369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.047965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.048215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.103683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:00.105897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.156351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 992/1968] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:00.161349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:00.171759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:00.177970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.178979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51cac2-5ae2-49ed-89ed-697bb60b44de None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:00.193646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:00.194693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.195084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.195467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.198534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:00.198909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:00.208349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:00.218381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec6f04-40a5-46cf-a1d7-97a1fe3780d4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:00.227669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:00.233374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:00.236305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.238815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.239424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] PATH_INFO: `/v3/projects/ddbce0677e62440a90b0fff420760512` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.242453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbce0677e62440a90b0fff420760512)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:00.246613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:00.251827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 977/1969] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:00.257740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:00.288208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e74007-1f34-425f-9460-2f517d3127a2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:00.294984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:00.295923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.296230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.297450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.298543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:00.300623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:00.335534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbce0677e62440a90b0fff420760512', 'request_id': 'req-92ba0697-c74d-44f4-9197-e54b08dd20a3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.346348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbce0677e62440a90b0fff420760512', 'request_id': 'req-92ba0697-c74d-44f4-9197-e54b08dd20a3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.361139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbce0677e62440a90b0fff420760512', 'request_id': 'req-92ba0697-c74d-44f4-9197-e54b08dd20a3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.384313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 978/1970] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:00 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:00.385426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:00.393332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.399453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] The token cache is being invalidate because project ddbce0677e62440a90b0fff420760512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:00.400025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.411530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.413496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 993/1971] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:00 2022] DELETE /identity/v3/projects/ddbce0677e62440a90b0fff420760512 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:00.414416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:00.416203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.448137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:00.515362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bd5ff-ca27-4e83-b708-cdf644da9497 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:00.520294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:00.521369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.523041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.523415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] PATH_INFO: `/v3/users/ff0b19b489244cbdbe50e7d76479cc32` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.528415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0b19b489244cbdbe50e7d76479cc32)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:00.531671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:00.537041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba0697-c74d-44f4-9197-e54b08dd20a3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:00.543238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:00.544399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.544748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.545132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] PATH_INFO: `/v3/projects/6bd9939f0a8646499455779efe463b4a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.546876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd9939f0a8646499455779efe463b4a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:00.548943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:00.641432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd9939f0a8646499455779efe463b4a', 'request_id': 'req-a82c54cf-1c72-4806-85bc-d9c888d11c85'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.658936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0b19b489244cbdbe50e7d76479cc32'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.659249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd9939f0a8646499455779efe463b4a', 'request_id': 'req-a82c54cf-1c72-4806-85bc-d9c888d11c85'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.660724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0b19b489244cbdbe50e7d76479cc32'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.680054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd9939f0a8646499455779efe463b4a', 'request_id': 'req-a82c54cf-1c72-4806-85bc-d9c888d11c85'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.687076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0b19b489244cbdbe50e7d76479cc32'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.707792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] The token cache is being invalidate because project 6bd9939f0a8646499455779efe463b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:00.708336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.709795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.712349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 994/1972] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:00 2022] DELETE /identity/v3/projects/6bd9939f0a8646499455779efe463b4a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:00.713560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:00.715910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.728930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0b19b489244cbdbe50e7d76479cc32'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.753216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-640c311e-3530-4d65-bbd7-6afa0e2d6658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0b19b489244cbdbe50e7d76479cc32'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:00.776752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 979/1973] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:00 2022] DELETE /identity/v3/users/ff0b19b489244cbdbe50e7d76479cc32 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:00.777340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7799-77f5-48bc-b9a7-fd63ddfcfc84 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.777833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7799-77f5-48bc-b9a7-fd63ddfcfc84 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.778492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7799-77f5-48bc-b9a7-fd63ddfcfc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.836475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4d5e7799-77f5-48bc-b9a7-fd63ddfcfc84 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:00.837808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c54cf-1c72-4806-85bc-d9c888d11c85 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:00.838179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4d5e7799-77f5-48bc-b9a7-fd63ddfcfc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:00.938877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:00.962607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca1ac-c5ac-4b3a-921f-0240ea2f55f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:00.965598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca1ac-c5ac-4b3a-921f-0240ea2f55f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:00.966192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca1ac-c5ac-4b3a-921f-0240ea2f55f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:00.967219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca1ac-c5ac-4b3a-921f-0240ea2f55f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:00.968751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca1ac-c5ac-4b3a-921f-0240ea2f55f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:00.972955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca1ac-c5ac-4b3a-921f-0240ea2f55f7 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.040111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:01.044332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 995/1974] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:00 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:01.047034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.047493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.051429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.085110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 980/1975] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:01.092419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6743b-ca00-4f00-b489-ed593fdff7dc None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.093210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6743b-ca00-4f00-b489-ed593fdff7dc None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.093875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6743b-ca00-4f00-b489-ed593fdff7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.110700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:01.118111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.147795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 996/1976] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:01.148959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.154085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.177664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee6de-6dea-4357-8d34-99acf064d8ea None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.180012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0ec6743b-ca00-4f00-b489-ed593fdff7dc None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:01.190117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0ec6743b-ca00-4f00-b489-ed593fdff7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.197098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df459-f786-4e3d-875a-1706c43b0a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.197910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df459-f786-4e3d-875a-1706c43b0a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.198292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df459-f786-4e3d-875a-1706c43b0a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.198664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df459-f786-4e3d-875a-1706c43b0a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.202425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df459-f786-4e3d-875a-1706c43b0a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.206343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df459-f786-4e3d-875a-1706c43b0a56 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.230190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 981/1977] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:01.232769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.233274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.236286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 997/1978] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:01.236455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.236554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.236554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.236554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.280078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:01.281748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:01.282721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.285623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.300761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 982/1979] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:01.302429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.309087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.310054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 998/1980] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:01.310987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.327152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9232bd8-229f-41b5-8f42-f8a6018e9e71 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.332209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.332891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.333553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.333670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.334899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.336590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.348998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eeb6f-a688-453b-a7d4-a1d9f4d5e60a None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.354919 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 999/1981] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:01.355905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.373594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.374437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.375908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.376212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] PATH_INFO: `/v3/users/81c14c0437964419ad68d234716a1b1e` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.377720 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bed86-378e-4762-8061-06727f3a14ca admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.378901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c14c0437964419ad68d234716a1b1e)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.383961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.390790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.391094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.391385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.396267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.402845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:01.403360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.406302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.425697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1000/1982] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:01.425697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.457014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaf943-678b-4a0a-95ee-7a135566dee6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.468801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.469680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.469680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.469680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.469680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:01.469680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.473378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.493159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1001/1983] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:01.494310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.514134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c14c0437964419ad68d234716a1b1e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:01.515832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c14c0437964419ad68d234716a1b1e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:01.517738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84ebb-fa1a-4668-9625-276220d73449 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.539079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.541792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c14c0437964419ad68d234716a1b1e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:01.549959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.550679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.551642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] PATH_INFO: `/v3/projects/3d1c0ae990014b8dbb65e0242ce26dcd/users/4812ff83630e4355929ac81ec1890d12/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.592310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1c0ae990014b8dbb65e0242ce26dcd, user_id=4812ff83630e4355929ac81ec1890d12, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.593477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c14c0437964419ad68d234716a1b1e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:01.598076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.613552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c14c0437964419ad68d234716a1b1e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:01.642649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 983/1984] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:01 2022] DELETE /identity/v3/users/81c14c0437964419ad68d234716a1b1e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:01.647241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1002/1985] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:01 2022] PUT /identity/v3/projects/3d1c0ae990014b8dbb65e0242ce26dcd/users/4812ff83630e4355929ac81ec1890d12/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:01.649924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.652497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.658124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.660248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.797936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422c1a9-d514-448d-9db2-e8dad1f8c083 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.802812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.803799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.804247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.804630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.807375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.824961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42e16-a5e4-4666-bae3-432f4e5211ca admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.938247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bbc03-63cf-46e0-b12c-045e2c7cf54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:01.938966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bbc03-63cf-46e0-b12c-045e2c7cf54d admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.939254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bbc03-63cf-46e0-b12c-045e2c7cf54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.939536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bbc03-63cf-46e0-b12c-045e2c7cf54d admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:01.940452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bbc03-63cf-46e0-b12c-045e2c7cf54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.942453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:01.944452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.947202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bbc03-63cf-46e0-b12c-045e2c7cf54d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:01.956590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:01.957597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 984/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:01.959701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:01.962554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:01.980038 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:01.986991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1003/1987] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/projects => generated 373 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:01.995908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92852b6f-fceb-41ad-9396-ce5c4004c465 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:01.996122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e332-c9e3-4056-a35d-4997ddef4702 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:01.996393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e332-c9e3-4056-a35d-4997ddef4702 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:01.996682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e332-c9e3-4056-a35d-4997ddef4702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.036893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-6734e332-c9e3-4056-a35d-4997ddef4702 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:02.041485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6734e332-c9e3-4056-a35d-4997ddef4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:02.117885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.119360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.120234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.120993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.122947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.127996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.191774 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 985/1988] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:02.192168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1004/1989] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:02.195697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.202559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.202965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.204368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.275112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] MFA Rules not processed for user `4812ff83630e4355929ac81ec1890d12`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:02.277281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:02.326403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a0fc-45ee-4986-9d27-8b838f199b5d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:02.343222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.344249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.350769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.351609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.352418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.355234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.416528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 986/1990] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:02 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:02.418243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.446405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d831-f032-4534-8917-7ba6bbdfece0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:02.448935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1005/1991] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:02.449885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.451430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:02.460460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.462059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.462605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.463936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.466174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.470418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.540268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 987/1992] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:02 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:02.541192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.555840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59f98-f1aa-42a8-b718-0cd7bf6a767f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:02.559642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d100d-e737-49e0-88d8-6ef1c6e010a7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:02.563157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.563941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.564310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.564716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.587343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.587641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.587641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.587979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.588129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.588129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.588129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.590284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.611874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1006/1993] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:02.612875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.614419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:02.615488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 988/1994] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:02.616442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.618324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:02.636093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b872d-0d35-4187-a7d9-db2f96fa8472 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:02.644105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.652640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.653492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.654120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.655568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.658454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.674172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebacb7-2cc8-4fdd-9f0b-72a86d9013f3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:02.694300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:02.694300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:02.694300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:02.694867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] PATH_INFO: `/v3/projects/054720b7c40743908feaa90e444f184a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:02.696498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054720b7c40743908feaa90e444f184a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:02.698635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:02.705836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:02.729331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1007/1995] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:02 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:02.729331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.792652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:02.800745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054720b7c40743908feaa90e444f184a', 'request_id': 'req-b30faedb-53dd-4981-9ba2-e8496c620d19'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:02.819604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054720b7c40743908feaa90e444f184a', 'request_id': 'req-b30faedb-53dd-4981-9ba2-e8496c620d19'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:02.832856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054720b7c40743908feaa90e444f184a', 'request_id': 'req-b30faedb-53dd-4981-9ba2-e8496c620d19'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:02.861822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] The token cache is being invalidate because project 054720b7c40743908feaa90e444f184a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:02.862124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:02.871687 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:02.877344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 989/1996] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:02 2022] DELETE /identity/v3/projects/054720b7c40743908feaa90e444f184a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:02.882064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:02.883656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:02.885100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474995f7-78fe-4c36-bcec-d46b6e3a0c4a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.009131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.009752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.010165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.010467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.011284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.012993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.019594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30faedb-53dd-4981-9ba2-e8496c620d19 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.029563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.032962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1008/1997] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:03.033136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.033136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.033136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.033136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.033445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.033840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.034695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.050218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 990/1998] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:03.052541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.055428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.079797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd34a23-b748-45c3-b686-f5624380b8f1 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.080376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644bc98-09cb-47e2-a9fa-68eba63e5ae1 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.088850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.090184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.090892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.091366 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] PATH_INFO: `/v3/users/9ebeb18af01246f78ca6eab94ea019fe` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.092409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.093115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.093396 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.093677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.094104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebeb18af01246f78ca6eab94ea019fe)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.094400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.097756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.102803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.156631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1009/1999] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:03 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:03.156631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.159545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.169107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebeb18af01246f78ca6eab94ea019fe'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.169830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebeb18af01246f78ca6eab94ea019fe'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.191837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebeb18af01246f78ca6eab94ea019fe'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.197142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3543e6c-0d2c-4d19-885b-9ee7b0a955c6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.216117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.217579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.217874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.218153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.219054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.220585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebeb18af01246f78ca6eab94ea019fe'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.220788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.231965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebeb18af01246f78ca6eab94ea019fe'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.238828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1010/2000] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:03.240070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.243103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.246240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 991/2001] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:03 2022] DELETE /identity/v3/users/9ebeb18af01246f78ca6eab94ea019fe => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:03.247225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.248767 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.258548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7e51-82ca-4508-9c78-8b1b40d5b557 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.354268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:03.367147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.368465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.368754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.369070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] PATH_INFO: `/v3/projects/f6e0378096244ca995a13ca65304004a/users/2e3952e3d3f0415dbc3f55d48c0cab4a/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.397862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e0378096244ca995a13ca65304004a, user_id=2e3952e3d3f0415dbc3f55d48c0cab4a, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.398098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489ed3-8d82-4275-aae9-2b0ec11a7b06 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.402734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.406298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.407935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.408329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.409097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.410062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.411990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.416941 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:03.425223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1011/2002] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:03 2022] PUT /identity/v3/projects/f6e0378096244ca995a13ca65304004a/users/2e3952e3d3f0415dbc3f55d48c0cab4a/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:03.426325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 992/2003] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:03.427723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.427973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.430376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.430851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.460201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04acb4-240e-4a38-93be-15ee4c51c0fe admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.532070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.534129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.534484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.534824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] PATH_INFO: `/v3/projects/e84bc4d58261452dab06f78277f051a3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.536188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84bc4d58261452dab06f78277f051a3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.538215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.543301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f38dfa-9702-4c90-ae91-2f4534926227 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.548880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.549804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.550535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.550535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] PATH_INFO: `/v3/projects/e22965b435874bdeaf2219432117ce77/users/02e35f434316482daab2095e9542ba7b/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.579680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22965b435874bdeaf2219432117ce77, user_id=02e35f434316482daab2095e9542ba7b, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.583494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.608228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1012/2004] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:03 2022] PUT /identity/v3/projects/e22965b435874bdeaf2219432117ce77/users/02e35f434316482daab2095e9542ba7b/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:03.609495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.612569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84bc4d58261452dab06f78277f051a3', 'request_id': 'req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.619601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84bc4d58261452dab06f78277f051a3', 'request_id': 'req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.631639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84bc4d58261452dab06f78277f051a3', 'request_id': 'req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.655429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] The token cache is being invalidate because project e84bc4d58261452dab06f78277f051a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:03.655975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.656900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d9aa2e15-c0b3-42c7-922a-84550ed97a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.665066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 993/2005] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:03 2022] DELETE /identity/v3/projects/e84bc4d58261452dab06f78277f051a3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:03.670084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.670468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.670777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.716974 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] MFA Rules not processed for user `2e3952e3d3f0415dbc3f55d48c0cab4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:03.718611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.744632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73a93-2839-47f7-919d-db296dee65af admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.750881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7072f3e-86ee-47ee-9084-f90a52c1c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.752062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7072f3e-86ee-47ee-9084-f90a52c1c2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.752347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7072f3e-86ee-47ee-9084-f90a52c1c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.752821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7072f3e-86ee-47ee-9084-f90a52c1c2fd admin admin] PATH_INFO: `/v3/projects/27e4142e875745dcb74c51d964314039/users/daf41d4a80084ed3bfb39235cb975faf/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.773986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7072f3e-86ee-47ee-9084-f90a52c1c2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e4142e875745dcb74c51d964314039, user_id=daf41d4a80084ed3bfb39235cb975faf, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.777858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7072f3e-86ee-47ee-9084-f90a52c1c2fd admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.788988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:03.793513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1013/2006] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:03 2022] PUT /identity/v3/projects/27e4142e875745dcb74c51d964314039/users/daf41d4a80084ed3bfb39235cb975faf/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:03.794872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.795168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.795476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.807809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 994/2007] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:03.809225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.810743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.825991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db751cf-33d0-4016-b1c6-ffc4ac042631 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.831480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] MFA Rules not processed for user `02e35f434316482daab2095e9542ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:03.832982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.897223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:03.897690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.898842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.898842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.899601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] PATH_INFO: `/v3/users/a4cf655b98374c1b9e8b5ecc7987fc46` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.900554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cf655b98374c1b9e8b5ecc7987fc46)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.902590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.917204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1014/2008] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:03.918566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:03.920548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:03.939241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04fc37-11ab-492d-8f34-62e64ea6e1ed None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:03.945915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:03.946988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:03.947317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:03.947715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] PATH_INFO: `/v3/projects/e4b8f55f8b82496a8a3f92e37bdda422` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:03.949165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b8f55f8b82496a8a3f92e37bdda422)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:03.952703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:03.968706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cf655b98374c1b9e8b5ecc7987fc46'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.970199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cf655b98374c1b9e8b5ecc7987fc46'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:03.983560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cf655b98374c1b9e8b5ecc7987fc46'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.000913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cf655b98374c1b9e8b5ecc7987fc46'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.009281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cf655b98374c1b9e8b5ecc7987fc46'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.019012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 995/2009] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:03 2022] DELETE /identity/v3/users/a4cf655b98374c1b9e8b5ecc7987fc46 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:04.019227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:04.020887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.026681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b8f55f8b82496a8a3f92e37bdda422', 'request_id': 'req-78c39726-4653-44de-abba-6a5e39fb5a58'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.035385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b8f55f8b82496a8a3f92e37bdda422', 'request_id': 'req-78c39726-4653-44de-abba-6a5e39fb5a58'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.045840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b8f55f8b82496a8a3f92e37bdda422', 'request_id': 'req-78c39726-4653-44de-abba-6a5e39fb5a58'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.064041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] The token cache is being invalidate because project e4b8f55f8b82496a8a3f92e37bdda422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:04.064547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.065283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.073346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1015/2010] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:03 2022] DELETE /identity/v3/projects/e4b8f55f8b82496a8a3f92e37bdda422 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:04.074553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:04.076837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.146395 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda526b3-ab95-4e7b-81fc-968afe93d288 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:04.151381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:04.152239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.152676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.152965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.153708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:04.155454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:04.171924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 996/2011] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:04.171924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:04.174003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.194353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c39726-4653-44de-abba-6a5e39fb5a58 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:04.205208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:04.327213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:04.327925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.328216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.329330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.333504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.337673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e8e6b-63e8-491d-92ff-9d01c4a8b5bb admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:04.357399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:04.358495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.359020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.359977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.363095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.421780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:04.455102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:04.457385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211eb0a-08d5-4ad2-b317-94e6072955f8 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:04.469243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:04.471149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:04.474380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1016/2012] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:04.479940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.480755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.481235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.485872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 997/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:04.508768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:04.513863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.515998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:04.518129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.535165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5826-e2d6-4da8-8bd4-371c8da04a75 service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:04.542913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1017/2014] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:04.544541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:04.546208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0520fa6-7f35-431b-bee4-d6a75b9f0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:04.547347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0520fa6-7f35-431b-bee4-d6a75b9f0ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.547751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.548057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0520fa6-7f35-431b-bee4-d6a75b9f0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.550457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0520fa6-7f35-431b-bee4-d6a75b9f0ffd admin admin] PATH_INFO: `/v3/projects/27e4142e875745dcb74c51d964314039/users/daf41d4a80084ed3bfb39235cb975faf/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.560360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0520fa6-7f35-431b-bee4-d6a75b9f0ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e4142e875745dcb74c51d964314039, user_id=daf41d4a80084ed3bfb39235cb975faf, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:04.568708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743caefc-d4e6-48ac-9732-ec3970da2010 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:04.571840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0520fa6-7f35-431b-bee4-d6a75b9f0ffd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:04.573637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:04.574646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.574832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.575096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] PATH_INFO: `/v3/users/2e3952e3d3f0415dbc3f55d48c0cab4a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.576347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3952e3d3f0415dbc3f55d48c0cab4a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:04.580060 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:04.599188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 998/2015] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:04 2022] PUT /identity/v3/projects/27e4142e875745dcb74c51d964314039/users/daf41d4a80084ed3bfb39235cb975faf/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:04.604987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789bd41-d7fb-475b-9fc1-05ec4f6eb78b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.605888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789bd41-d7fb-475b-9fc1-05ec4f6eb78b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.606467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789bd41-d7fb-475b-9fc1-05ec4f6eb78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.653756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7789bd41-d7fb-475b-9fc1-05ec4f6eb78b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:04.668055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7789bd41-d7fb-475b-9fc1-05ec4f6eb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.708253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3952e3d3f0415dbc3f55d48c0cab4a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.709594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3952e3d3f0415dbc3f55d48c0cab4a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.725406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3952e3d3f0415dbc3f55d48c0cab4a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.751670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3952e3d3f0415dbc3f55d48c0cab4a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.751670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3952e3d3f0415dbc3f55d48c0cab4a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.784053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1018/2016] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:04 2022] DELETE /identity/v3/users/2e3952e3d3f0415dbc3f55d48c0cab4a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:04.785414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:04.787410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.804029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 999/2017] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:04.805525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721bf5-f83d-4ea9-85a4-b327dede2a92 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.805819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721bf5-f83d-4ea9-85a4-b327dede2a92 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.806103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721bf5-f83d-4ea9-85a4-b327dede2a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.848912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-87721bf5-f83d-4ea9-85a4-b327dede2a92 None None] MFA Rules not processed for user `daf41d4a80084ed3bfb39235cb975faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:04.850652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-87721bf5-f83d-4ea9-85a4-b327dede2a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.883267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:04.891817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d897-be74-498a-8f2d-3291e4b01104 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:04.900854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:04.902125 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.902230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.902535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] PATH_INFO: `/v3/projects/d4977a4e1f3c4de394cb81fb70033f77` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.903856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4977a4e1f3c4de394cb81fb70033f77)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:04.906184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:04.956291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1000/2018] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:04.958595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:04.958955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:04.959243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:04.981411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:04.982741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:04.983146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4977a4e1f3c4de394cb81fb70033f77', 'request_id': 'req-3bd47399-727a-4f07-9ebd-59d52bb6c784'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:04.989488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:04.992829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4977a4e1f3c4de394cb81fb70033f77', 'request_id': 'req-3bd47399-727a-4f07-9ebd-59d52bb6c784'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.005069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4977a4e1f3c4de394cb81fb70033f77', 'request_id': 'req-3bd47399-727a-4f07-9ebd-59d52bb6c784'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.025975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] The token cache is being invalidate because project d4977a4e1f3c4de394cb81fb70033f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:05.026269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.027337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.029593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1019/2019] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:04 2022] DELETE /identity/v3/projects/d4977a4e1f3c4de394cb81fb70033f77 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:05.030480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.032328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.077745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1001/2020] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:05.083567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.088782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.107362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e00d-70b4-42a3-b6f8-210f44951766 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.119715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.120960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.121397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.121770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] PATH_INFO: `/v3/users/02e35f434316482daab2095e9542ba7b` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.123455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e35f434316482daab2095e9542ba7b)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.125941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.133594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd47399-727a-4f07-9ebd-59d52bb6c784 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.143985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.144723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.145098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.145384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.147201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:05.147201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.149155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.170162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1020/2021] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:05.171087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.173078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.207674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e35f434316482daab2095e9542ba7b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.208553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e35f434316482daab2095e9542ba7b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.219113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e35f434316482daab2095e9542ba7b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.244258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e35f434316482daab2095e9542ba7b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.252020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-178d889c-ea00-429c-a1b4-b7bfca43ef56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e35f434316482daab2095e9542ba7b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:05.258925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1002/2022] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:05 2022] DELETE /identity/v3/users/02e35f434316482daab2095e9542ba7b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:05.260435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.260735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.261020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.262670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a61029-7ade-4bad-800e-0a817b2a4107 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.284658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:05.286508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.335836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.336734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.337124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.337539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.340402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:05.342487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.395237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1003/2023] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:05.395237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.395237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.440707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:05.464525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.466104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.466972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82361-d35b-4d10-8a87-7830adb54199 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.471796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.472470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.472751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.473026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.475444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.480288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1021/2024] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:05.481120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.482691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.489441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.491872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671ea7f-e7f6-40cb-86f5-cde8613c660d service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.500575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b94dd-9f52-4210-b65d-c5738cedae45 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.503497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1004/2025] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:05.504985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.505277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.505548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.507219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a453e-a4d7-4c7b-a0cc-8bfdc0d95bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.509769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a453e-a4d7-4c7b-a0cc-8bfdc0d95bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.510242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a453e-a4d7-4c7b-a0cc-8bfdc0d95bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.510749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a453e-a4d7-4c7b-a0cc-8bfdc0d95bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.511745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a453e-a4d7-4c7b-a0cc-8bfdc0d95bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.514111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a453e-a4d7-4c7b-a0cc-8bfdc0d95bb1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.553173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:05.554495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.577404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1022/2026] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:05 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:05.577404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.577404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.577404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.595946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1005/2027] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:05.597347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.602033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:05.603263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.615006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a9f5d-7f79-486e-bdc0-e767a9909455 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.707996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.708894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.710629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.710923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.711746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.716946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.726397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1023/2028] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:05.732807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.738062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:05.755309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1006/2029] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:05 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:05.757012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.786795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f5e7-5a6b-4a4a-b222-6f7ad448ee24 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.796567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.800231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.800530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.801335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.802799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:05.803220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.805420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.855574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1007/2030] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:05.856718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.871293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4c21-1b5f-4986-b7e1-ee4598b0829c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.875839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.876521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.876802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.877075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.895052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7448af-1e32-438a-bfea-0b334d1a1e62 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.904469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.905175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.905464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.905745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.906655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.907444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.908753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.910318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.934972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1024/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:05.939366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.940480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1008/2032] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:05.963109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019f06-7323-4672-b75b-799fb7a12e94 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:05.965777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:05.967670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:05.972274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:05.972274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:05.972274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:05.972274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:05.975172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:05.992597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418340aa-f887-423b-b352-e26ec15e395a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.009942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.011792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.011792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.016045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.017300 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.020065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.035718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1009/2033] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:06.038453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.056045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4eab1-8ea6-44a8-887c-7878919730a7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.060263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1025/2034] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:05 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:06.070372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.097009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:06.192551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.194062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.194488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.194780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] PATH_INFO: `/v3/projects/6e21db26fca94bec855f49daf12e0300/users/b519b5d7a59f4712bd83b649e65ad8e8/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.205107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:06.217854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e21db26fca94bec855f49daf12e0300, user_id=b519b5d7a59f4712bd83b649e65ad8e8, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.220621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.238173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd8d5-d5cf-434b-aa08-7c192dbe0724 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.256515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1010/2035] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:06 2022] PUT /identity/v3/projects/6e21db26fca94bec855f49daf12e0300/users/b519b5d7a59f4712bd83b649e65ad8e8/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:06.256515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.261016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.320404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.321433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.321722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.322006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.323000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.325925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.347021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61fe8-f779-4580-93da-5cc591ff1ee3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.358780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1026/2036] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:06 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:06.359792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.361537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.363101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.363739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.364022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.364385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] PATH_INFO: `/v3/projects/f6e0378096244ca995a13ca65304004a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.366427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e0378096244ca995a13ca65304004a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.368449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.376029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26179-9eab-44a7-8e38-15c4299b0405 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.387409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.388505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.389560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.389560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] PATH_INFO: `/v3/users/4812ff83630e4355929ac81ec1890d12` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.391501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4812ff83630e4355929ac81ec1890d12)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.393667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.448791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e0378096244ca995a13ca65304004a', 'request_id': 'req-5e532b66-5f80-4346-a706-62c887ebfc60'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.454451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4812ff83630e4355929ac81ec1890d12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.455645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4812ff83630e4355929ac81ec1890d12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.456185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e0378096244ca995a13ca65304004a', 'request_id': 'req-5e532b66-5f80-4346-a706-62c887ebfc60'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.464796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e0378096244ca995a13ca65304004a', 'request_id': 'req-5e532b66-5f80-4346-a706-62c887ebfc60'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.465451 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4812ff83630e4355929ac81ec1890d12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.479196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] The token cache is being invalidate because project f6e0378096244ca995a13ca65304004a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:06.479501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.480187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5e532b66-5f80-4346-a706-62c887ebfc60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.480832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4812ff83630e4355929ac81ec1890d12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.481545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4812ff83630e4355929ac81ec1890d12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.481787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1011/2037] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:06 2022] DELETE /identity/v3/projects/f6e0378096244ca995a13ca65304004a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:06.491994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.491994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.491994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.513214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1027/2038] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:06 2022] DELETE /identity/v3/users/4812ff83630e4355929ac81ec1890d12 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:06.518072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.519541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.520837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] MFA Rules not processed for user `b519b5d7a59f4712bd83b649e65ad8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:06.522097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.566211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:06.606641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:06.624787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de20f-dcdc-4e71-89be-056cef06639e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.634574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1012/2039] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:06.634574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.635835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd18027-c135-4c15-94eb-b66e7aef75eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.636633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.637137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18027-c135-4c15-94eb-b66e7aef75eb admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.637794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18027-c135-4c15-94eb-b66e7aef75eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.638480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18027-c135-4c15-94eb-b66e7aef75eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.639675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd18027-c135-4c15-94eb-b66e7aef75eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.641464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd18027-c135-4c15-94eb-b66e7aef75eb admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.665395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1028/2040] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:06.665693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6663c-b35f-4ce9-bca2-daf25fa4cd55 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.665884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.665884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.665884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.673821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.675805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.676428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.676982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] PATH_INFO: `/v3/projects/e22965b435874bdeaf2219432117ce77` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.683788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22965b435874bdeaf2219432117ce77)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.686172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.692285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:06.693581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.702251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1029/2041] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:06.703296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.705030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.717969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f832a7-d1ed-443b-b19e-e16f61bc5e02 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.722802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.723561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.723887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.724156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.725453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.727533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.756902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22965b435874bdeaf2219432117ce77', 'request_id': 'req-64c58ad3-8e39-4412-9ecb-87c33855d5c5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.764702 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22965b435874bdeaf2219432117ce77', 'request_id': 'req-64c58ad3-8e39-4412-9ecb-87c33855d5c5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.770535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1030/2042] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:06 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:06.772068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.772504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22965b435874bdeaf2219432117ce77', 'request_id': 'req-64c58ad3-8e39-4412-9ecb-87c33855d5c5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.788083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] The token cache is being invalidate because project e22965b435874bdeaf2219432117ce77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:06.788385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.789073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:06.791660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1013/2043] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:06 2022] DELETE /identity/v3/projects/e22965b435874bdeaf2219432117ce77 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:06.791660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.794785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.869121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58ad3-8e39-4412-9ecb-87c33855d5c5 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.892857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3d65-ca46-4105-bb43-ceaa871a9839 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.898939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.899664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.899949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.900271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.901317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.903214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.924010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1031/2044] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:06.925341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.927399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.934672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.935918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.935918 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.936301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.938413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.941063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef23ca-2012-4665-b012-7c3ceca25b77 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:06.946072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:06.946835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.947191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.947473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.948229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.953066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.954572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:06.956986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c45f1f-8da0-4c11-94d1-32663be1e7b0 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:06.981476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1014/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:06.982228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1032/2046] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:06 2022] POST /identity/v3/users => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:06.983116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:06.984622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:06.985194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:06.985309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:06.985809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:06.998664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad5c5-d5e8-4a57-9d5d-2404ae52fc76 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.003747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ab10d-a73b-471f-a954-991601d02b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.004663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab10d-a73b-471f-a954-991601d02b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.005277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab10d-a73b-471f-a954-991601d02b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.005498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab10d-a73b-471f-a954-991601d02b2e admin admin] PATH_INFO: `/v3/projects/0c505d305a8f4c1c8949cf08be9432e7/users/942fc767b94c436e9a5e5e70d3ba917d/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.023833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:07.025942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.027054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ab10d-a73b-471f-a954-991601d02b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c505d305a8f4c1c8949cf08be9432e7, user_id=942fc767b94c436e9a5e5e70d3ba917d, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.029843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ab10d-a73b-471f-a954-991601d02b2e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.055650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1015/2047] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:07.055650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.055979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1033/2048] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:06 2022] PUT /identity/v3/projects/0c505d305a8f4c1c8949cf08be9432e7/users/942fc767b94c436e9a5e5e70d3ba917d/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:07.056070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:07.063051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1eefb-6e99-4e87-ba45-54720afffa60 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.063481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1eefb-6e99-4e87-ba45-54720afffa60 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.063936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1eefb-6e99-4e87-ba45-54720afffa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.065993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35900-0976-476d-a910-59efa1cd51af None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.095736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-45e1eefb-6e99-4e87-ba45-54720afffa60 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:07.097435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-45e1eefb-6e99-4e87-ba45-54720afffa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.170229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.170916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.171207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.171485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.172262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.173937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.180928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1034/2049] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:07.185786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.186410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.186854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.190236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1016/2050] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:07.191204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.203876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb4ba-ec7e-4031-b395-0779dfd5de7e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.209223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.209893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.210189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.210469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.211204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:07.211518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.213182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.226397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:07.226642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1017/2051] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:07.229284 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.231282 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] MFA Rules not processed for user `942fc767b94c436e9a5e5e70d3ba917d`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:07.233565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.241955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269131-bd0e-4e55-93c8-1a56f0abc7f4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.250519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.250519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.250519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.250519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] PATH_INFO: `/v3/projects/475cb78306af485b905d07e6d219e9ec/users/e03fa67028c342cfb861d3154921d3fd/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.268157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=475cb78306af485b905d07e6d219e9ec, user_id=e03fa67028c342cfb861d3154921d3fd, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.270739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.293709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1018/2052] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:07 2022] PUT /identity/v3/projects/475cb78306af485b905d07e6d219e9ec/users/e03fa67028c342cfb861d3154921d3fd/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:07.294331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.354590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1035/2053] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:07.355743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.376639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59968-8d0a-4201-9b4c-1139e000abc4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.423945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44b93e-f82a-4245-97c9-0c154d6e3fdb admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.429229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.429906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.430202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.430523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.431673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.434324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.481661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1019/2054] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:07.483183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.499920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.501255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.502042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.503191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.505256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.509272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.536909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1036/2055] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:07.536909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.539682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.560854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6162-2233-4e6d-913c-c9f89dc4ce4b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.576036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:07.595023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040513b7-52f1-411f-8ada-ca08a1f2a510 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.601802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.602574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.602929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.603282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.604087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.606108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.635724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.636302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1020/2056] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:07.636739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.637102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.637387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] PATH_INFO: `/v3/projects/3d1c0ae990014b8dbb65e0242ce26dcd` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.637497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.638725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1c0ae990014b8dbb65e0242ce26dcd)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.641523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.694261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:07.701320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1c0ae990014b8dbb65e0242ce26dcd', 'request_id': 'req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:07.707420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1c0ae990014b8dbb65e0242ce26dcd', 'request_id': 'req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:07.713071 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877d0b-b578-4379-a461-9dac57bfaff3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.716170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1c0ae990014b8dbb65e0242ce26dcd', 'request_id': 'req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:07.731650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] The token cache is being invalidate because project 3d1c0ae990014b8dbb65e0242ce26dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:07.731956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:07.732664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:07.734297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1037/2057] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:07 2022] DELETE /identity/v3/projects/3d1c0ae990014b8dbb65e0242ce26dcd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:07.738490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.740030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.777572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.778258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.778539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.778826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.779525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.781540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.809060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1021/2058] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:07.810173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.811954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.816371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f2c1-5e3a-4fbf-a456-2191e5595d9c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.821782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.822683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.822960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.823235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] PATH_INFO: `/v3/projects/475cb78306af485b905d07e6d219e9ec/users/e03fa67028c342cfb861d3154921d3fd/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.825263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475cb78306af485b905d07e6d219e9ec, user_id=e03fa67028c342cfb861d3154921d3fd, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.825613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f9d29-63e1-4149-83dd-96af2e95fc9d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.828494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.830914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.831861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.832152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.832820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.833550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.836195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.841170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1038/2059] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:07 2022] PUT /identity/v3/projects/475cb78306af485b905d07e6d219e9ec/users/e03fa67028c342cfb861d3154921d3fd/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:07.841777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.851471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.861294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1022/2060] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/users => generated 299 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:07.861294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:07.861594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:07.874062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9903c-68d5-46c3-9908-9a8a1595383f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.934647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:07.937191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472e954-4de5-4de0-83d8-0228adf3adc8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:07.942907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.944576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.944824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.945063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] PATH_INFO: `/v3/users/daf41d4a80084ed3bfb39235cb975faf` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.946421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf41d4a80084ed3bfb39235cb975faf)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.947148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4f1bf-1d36-4ace-b68c-ba1682a59052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:07.947890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4f1bf-1d36-4ace-b68c-ba1682a59052 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.948207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4f1bf-1d36-4ace-b68c-ba1682a59052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.948607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4f1bf-1d36-4ace-b68c-ba1682a59052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.948777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.949451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4f1bf-1d36-4ace-b68c-ba1682a59052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:07.951319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4f1bf-1d36-4ace-b68c-ba1682a59052 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:07.963291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1023/2061] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:07.964847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:07.965136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:07.965417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:07.996190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] MFA Rules not processed for user `e03fa67028c342cfb861d3154921d3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:07.997419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.016993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf41d4a80084ed3bfb39235cb975faf'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.017765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf41d4a80084ed3bfb39235cb975faf'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.029468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf41d4a80084ed3bfb39235cb975faf'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.044491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:08.054063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf41d4a80084ed3bfb39235cb975faf'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.055327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf41d4a80084ed3bfb39235cb975faf'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.073310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1039/2062] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:07 2022] DELETE /identity/v3/users/daf41d4a80084ed3bfb39235cb975faf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:08.074820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.076819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.089092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1024/2063] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:08.090209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.094014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.110549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859cdb-c011-441b-8dce-1d6eb6c6062c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.214888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.216733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3a6a-c9ae-4766-a4da-3841d8ad1ae9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.217900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.218431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.218939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.220454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.223591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.225399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.226225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.226794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.227390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.228887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.232185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.250270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1025/2064] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:08.250270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.252390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.259704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1040/2065] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:08.259704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.274778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbe56-28bd-46eb-b6e8-720904666ed9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.283036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.284074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.284418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.285044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] PATH_INFO: `/v3/projects/d6d6e4ab04cf48d78e07d4f1ed28b04b/users/1605acdcf27644039e06ae976342f68c/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.304064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d6e4ab04cf48d78e07d4f1ed28b04b, user_id=1605acdcf27644039e06ae976342f68c, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.307801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.331734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1041/2066] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:08 2022] PUT /identity/v3/projects/d6d6e4ab04cf48d78e07d4f1ed28b04b/users/1605acdcf27644039e06ae976342f68c/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:08.334122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.369484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a95b-1c96-421c-b87b-911df5cab723 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.413541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:08.444904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8b400-ee32-4c5b-a66c-e0c097f547ab admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.454558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4bb0e-981e-4c0c-b6dd-bf22413bfbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.455484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bb0e-981e-4c0c-b6dd-bf22413bfbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.455830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bb0e-981e-4c0c-b6dd-bf22413bfbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.456131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bb0e-981e-4c0c-b6dd-bf22413bfbc9 admin admin] PATH_INFO: `/v3/projects/767476d7cad14bf2a83b40c4cb975d58/users/f4b7f1f2e8994e9ab749685edabe182f/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.462930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.464659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.465057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.465482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.477964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4bb0e-981e-4c0c-b6dd-bf22413bfbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767476d7cad14bf2a83b40c4cb975d58, user_id=f4b7f1f2e8994e9ab749685edabe182f, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.481589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4bb0e-981e-4c0c-b6dd-bf22413bfbc9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.505345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1042/2067] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:08 2022] PUT /identity/v3/projects/767476d7cad14bf2a83b40c4cb975d58/users/f4b7f1f2e8994e9ab749685edabe182f/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:08.511052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.511647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.512120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.551705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] MFA Rules not processed for user `1605acdcf27644039e06ae976342f68c`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:08.553622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.567960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.567960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.580913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1026/2068] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:08.582007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.597641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db32f5-99a4-40c7-a7e2-49bbf917a93d service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.600831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:08.702767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1043/2069] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:08.702767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.714504 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.724220 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.724919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.725828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.726223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.727190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.729007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.746502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1027/2070] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:08.747798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.760243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35fb5d-b98e-44ec-b8f4-c184073c5d74 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.772758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.773441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.773729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.774009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.774713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.777036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.808655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1028/2071] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:08 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:08.809607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a484c8-6a29-4437-a9dc-9b8bbc54e622 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.809770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.885371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.886303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.886583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.886858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] PATH_INFO: `/v3/projects/27e4142e875745dcb74c51d964314039` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.888137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e4142e875745dcb74c51d964314039)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.889853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:08.897146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.918910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e2053-d6f4-4997-b2f4-e6cbb3db5207 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:08.923951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:08.924857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:08.925208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:08.925487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] PATH_INFO: `/v3/projects/767476d7cad14bf2a83b40c4cb975d58/users/f4b7f1f2e8994e9ab749685edabe182f/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:08.928277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=767476d7cad14bf2a83b40c4cb975d58, user_id=f4b7f1f2e8994e9ab749685edabe182f, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:08.931946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:08.945359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1029/2072] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:08 2022] PUT /identity/v3/projects/767476d7cad14bf2a83b40c4cb975d58/users/f4b7f1f2e8994e9ab749685edabe182f/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:08.946193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.948066 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:08.956638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e4142e875745dcb74c51d964314039', 'request_id': 'req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.963529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e4142e875745dcb74c51d964314039', 'request_id': 'req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.971710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e4142e875745dcb74c51d964314039', 'request_id': 'req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.989771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] The token cache is being invalidate because project 27e4142e875745dcb74c51d964314039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:08.992514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.993274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:08.994906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1044/2073] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:08 2022] DELETE /identity/v3/projects/27e4142e875745dcb74c51d964314039 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:08.995690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:08.997612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.005438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:09.045034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21d1f-47ed-41a8-a63e-ce83c76de4be admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.086120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb0f2f-0671-4d8c-a6f7-551cc1711ab3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.091338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63cb62-2481-4318-8ccb-4e1356188b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.092086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63cb62-2481-4318-8ccb-4e1356188b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.092431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63cb62-2481-4318-8ccb-4e1356188b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.092716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63cb62-2481-4318-8ccb-4e1356188b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.093435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63cb62-2481-4318-8ccb-4e1356188b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.095492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63cb62-2481-4318-8ccb-4e1356188b93 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.120884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.121452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1045/2074] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:08 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:09.121830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.122097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.122376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] PATH_INFO: `/v3/users/b519b5d7a59f4712bd83b649e65ad8e8` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.123211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3170386-e313-4c62-86c1-9487a49157a0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.123571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3170386-e313-4c62-86c1-9487a49157a0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.123897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3170386-e313-4c62-86c1-9487a49157a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.124184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b519b5d7a59f4712bd83b649e65ad8e8)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.126132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.157966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e3170386-e313-4c62-86c1-9487a49157a0 None None] MFA Rules not processed for user `f4b7f1f2e8994e9ab749685edabe182f`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:09.159251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e3170386-e313-4c62-86c1-9487a49157a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.209710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b519b5d7a59f4712bd83b649e65ad8e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.210530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b519b5d7a59f4712bd83b649e65ad8e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.220271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b519b5d7a59f4712bd83b649e65ad8e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.234863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b519b5d7a59f4712bd83b649e65ad8e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.245103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b519b5d7a59f4712bd83b649e65ad8e8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.254080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1046/2075] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:09.256360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8da26-c343-4cc9-ab5e-1fd12785f425 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.257577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8da26-c343-4cc9-ab5e-1fd12785f425 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.257577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8da26-c343-4cc9-ab5e-1fd12785f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.263700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1030/2076] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:08 2022] DELETE /identity/v3/users/b519b5d7a59f4712bd83b649e65ad8e8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:09.265940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.268056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.279283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:09.293616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-cbe8da26-c343-4cc9-ab5e-1fd12785f425 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:09.295403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cbe8da26-c343-4cc9-ab5e-1fd12785f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.347534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71f03c-563d-44a6-87be-74e85d8cfba7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.353437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.354344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.354626 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.354899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.358701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.360407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.366314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1047/2077] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:09.368473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b238d86-532b-4bb0-8da3-e6c4e8302daf None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.368893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b238d86-532b-4bb0-8da3-e6c4e8302daf None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.369349 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b238d86-532b-4bb0-8da3-e6c4e8302daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.375549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1031/2078] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:09.375549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.376853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.391303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4b238d86-532b-4bb0-8da3-e6c4e8302daf None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:09.392539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4b238d86-532b-4bb0-8da3-e6c4e8302daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.400658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1048/2079] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:09.402091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.402374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.402653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.427274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:09.430115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.442443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1049/2080] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:09.444275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.454523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a440-5928-4913-9037-c69c6c8fb741 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.455842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8b93-d8ad-43a2-81d0-a558920796b0 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.458735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.459409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.459948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.460231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.461522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.462587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.462772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.462909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.463138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] PATH_INFO: `/v3/projects/d79dc2f361314ea6afbe595c6d8e83c6/users/a3d561c1549c40ad8bdf038e5c6f0517/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.468629 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:09.488197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79dc2f361314ea6afbe595c6d8e83c6, user_id=a3d561c1549c40ad8bdf038e5c6f0517, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.494664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.512608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1050/2081] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:09 2022] PUT /identity/v3/projects/d79dc2f361314ea6afbe595c6d8e83c6/users/a3d561c1549c40ad8bdf038e5c6f0517/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:09.516701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.518730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.543741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.545228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.556817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1032/2082] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:09.557424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.568321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf2aca-8f58-449d-b539-efa053f087ab service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.596462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef8c74-ad77-4119-9da6-e435c344f48a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.604989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.605673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.617803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.617803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.681394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:09.687192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.688280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.688630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.689020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.689787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:09.690169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.691884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.697550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.699043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.710065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1033/2083] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:09.710065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.711682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1051/2084] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:09.712604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.714487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.720905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b24e-a9de-406e-9db8-97807cac37a8 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.729308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.730034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.730158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b732ef-b25c-4758-91e1-3518af095492 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.730361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.730572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.731504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.733165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.735414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.736430 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.736894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.737403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] PATH_INFO: `/v3/users/942fc767b94c436e9a5e5e70d3ba917d` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.739147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] RBAC: Authorizing `identity:delete_user(user_id=942fc767b94c436e9a5e5e70d3ba917d)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.742898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.748877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1034/2085] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:09.750145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.760816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67672be3-5d63-47d2-9bca-f67f2dbd2dcc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.767966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.768658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.769014 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.769195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.769955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.772540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.815317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1035/2086] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:09 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:09.816968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.821499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942fc767b94c436e9a5e5e70d3ba917d'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.822665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942fc767b94c436e9a5e5e70d3ba917d'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.833257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942fc767b94c436e9a5e5e70d3ba917d'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.848725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942fc767b94c436e9a5e5e70d3ba917d'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.850111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942fc767b94c436e9a5e5e70d3ba917d'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:09.865559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1052/2087] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:09 2022] DELETE /identity/v3/users/942fc767b94c436e9a5e5e70d3ba917d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:09.867896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:09.870523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:09.878420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:09.903347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4aa7-d3d7-4805-b508-cb71bcc76196 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.970405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0995278-9a62-4fcc-9fc4-eb95639b879e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:09.978274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c00b52-afc7-47dd-940b-d6084d12dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.979320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c00b52-afc7-47dd-940b-d6084d12dfca admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.979804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c00b52-afc7-47dd-940b-d6084d12dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.980256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c00b52-afc7-47dd-940b-d6084d12dfca admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.981009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c00b52-afc7-47dd-940b-d6084d12dfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.983349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9a4f4-9330-4d12-814a-b8d538aafb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:09.983926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c00b52-afc7-47dd-940b-d6084d12dfca admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:09.984288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9a4f4-9330-4d12-814a-b8d538aafb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:09.984574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9a4f4-9330-4d12-814a-b8d538aafb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:09.984852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9a4f4-9330-4d12-814a-b8d538aafb85 admin admin] PATH_INFO: `/v3/projects/d79dc2f361314ea6afbe595c6d8e83c6/users/a3d561c1549c40ad8bdf038e5c6f0517/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:09.986939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9a4f4-9330-4d12-814a-b8d538aafb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79dc2f361314ea6afbe595c6d8e83c6, user_id=a3d561c1549c40ad8bdf038e5c6f0517, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:09.989954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9a4f4-9330-4d12-814a-b8d538aafb85 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.012319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1036/2088] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:09 2022] PUT /identity/v3/projects/d79dc2f361314ea6afbe595c6d8e83c6/users/a3d561c1549c40ad8bdf038e5c6f0517/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:10.012319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.012319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.012319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.017840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1053/2089] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:09 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:10.020673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.021232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.022032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.032562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:10.033943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.055929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] MFA Rules not processed for user `a3d561c1549c40ad8bdf038e5c6f0517`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:10.057527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.094004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:10.106232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1037/2090] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:10.106976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.117350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec5ad0-d2ca-4e91-a712-42e5521dba71 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.123107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.124023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.124521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.124746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.125574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.127460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.140068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1038/2091] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:10.141296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.145536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.154711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1054/2092] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:10.155412 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.156846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.165642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db3e88-9140-44c9-b18d-b175530f0899 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.174063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.174971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.175383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.175817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] PATH_INFO: `/v3/projects/6e21db26fca94bec855f49daf12e0300` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.177533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e21db26fca94bec855f49daf12e0300)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.179737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.223822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf085-0a87-4323-97c7-8a2e87e7723d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.234709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e21db26fca94bec855f49daf12e0300', 'request_id': 'req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.241406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e21db26fca94bec855f49daf12e0300', 'request_id': 'req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.249235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e21db26fca94bec855f49daf12e0300', 'request_id': 'req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.261656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:10.264033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] The token cache is being invalidate because project 6e21db26fca94bec855f49daf12e0300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:10.264749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.265517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.267151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1039/2093] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:10 2022] DELETE /identity/v3/projects/6e21db26fca94bec855f49daf12e0300 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:10.268018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.269663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.288931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.290052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.290554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.291042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.294189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.344192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4e16c-7bc5-4cbf-bf1c-4b0e566415e0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.349056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.349877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.350196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.350666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.351561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.353452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.378978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1040/2094] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:10.381238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.384063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.391902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.393377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.405686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1055/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:10.406626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.408086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.421462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5cf93-aa0f-4069-a322-3ddaf9e0b203 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.426825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.428372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.428718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.429057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] PATH_INFO: `/v3/users/e03fa67028c342cfb861d3154921d3fd` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.432130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03fa67028c342cfb861d3154921d3fd)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.434424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.471051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5b0b-790a-43c8-8c58-d313043b049f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.476406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.477272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.477520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.477879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.480010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.493703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03fa67028c342cfb861d3154921d3fd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.494740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03fa67028c342cfb861d3154921d3fd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.506500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03fa67028c342cfb861d3154921d3fd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.506729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:10.524697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03fa67028c342cfb861d3154921d3fd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.525750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03fa67028c342cfb861d3154921d3fd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:10.539083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1056/2096] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:10 2022] DELETE /identity/v3/users/e03fa67028c342cfb861d3154921d3fd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:10.539874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.543359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.551882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.553920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd45a-041f-4051-a14f-3f433369ed2d service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.574770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1041/2097] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:10.634818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:10.641264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7491a-9671-4650-a0ef-54fa51e3d77d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:10.663334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:10.664550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.664839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.665120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] PATH_INFO: `/v3/projects/357a0d37747545239e4b7f608f10ea7b/users/8649d914ed8f48dcb4e0289895c81d8e/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.695178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357a0d37747545239e4b7f608f10ea7b, user_id=8649d914ed8f48dcb4e0289895c81d8e, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:10.705809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:10.739666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1057/2098] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:10 2022] PUT /identity/v3/projects/357a0d37747545239e4b7f608f10ea7b/users/8649d914ed8f48dcb4e0289895c81d8e/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:10.748606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:10.748606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:10.748606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:10.809907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] MFA Rules not processed for user `8649d914ed8f48dcb4e0289895c81d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:10.812448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.916096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.917873 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:10.949597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1042/2099] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:10.968326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:10.970452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:11.035177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0924be-e6a9-4aec-a6b5-945eb53d7773 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.054278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.055165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.055475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.055926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] PATH_INFO: `/v3/projects/0c505d305a8f4c1c8949cf08be9432e7` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.057596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c505d305a8f4c1c8949cf08be9432e7)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.059999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.095116 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d340b9c-5512-41a3-8fa0-1136bcb0e589 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.123681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.124374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.124651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.124935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.136639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.138253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.141712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c505d305a8f4c1c8949cf08be9432e7', 'request_id': 'req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.149948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1043/2100] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:11.150252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c505d305a8f4c1c8949cf08be9432e7', 'request_id': 'req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.150933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.152503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:11.159721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c505d305a8f4c1c8949cf08be9432e7', 'request_id': 'req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.168546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157c05e-7a93-46ed-a360-3ea0c0b6c4db service glance] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.178956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] The token cache is being invalidate because project 0c505d305a8f4c1c8949cf08be9432e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:11.179252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.180003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.181840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1058/2101] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:10 2022] DELETE /identity/v3/projects/0c505d305a8f4c1c8949cf08be9432e7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:11.185973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.187815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:11.240410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:11.251963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.252839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.253128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.253404 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] PATH_INFO: `/v3/projects/475cb78306af485b905d07e6d219e9ec` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.254644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=475cb78306af485b905d07e6d219e9ec)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.256627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.268073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb46e01-8164-4916-9c19-ebe15fd3a3d8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.276829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.279147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.279426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.279520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] PATH_INFO: `/v3/users/f4b7f1f2e8994e9ab749685edabe182f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.281276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b7f1f2e8994e9ab749685edabe182f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.283385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.303456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:11.341823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475cb78306af485b905d07e6d219e9ec', 'request_id': 'req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.348081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475cb78306af485b905d07e6d219e9ec', 'request_id': 'req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.351052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b7f1f2e8994e9ab749685edabe182f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.352105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b7f1f2e8994e9ab749685edabe182f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.357563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475cb78306af485b905d07e6d219e9ec', 'request_id': 'req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.376285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b7f1f2e8994e9ab749685edabe182f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.378668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] The token cache is being invalidate because project 475cb78306af485b905d07e6d219e9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:11.378984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.379790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-98c1dd88-afad-4c2d-9025-e8c3f6eeb17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.385245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1044/2102] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:11 2022] DELETE /identity/v3/projects/475cb78306af485b905d07e6d219e9ec => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:11.387474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.387810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.388192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.395846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b7f1f2e8994e9ab749685edabe182f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.399496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d46e45ae-e207-40a5-b22f-7fb576b1a64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b7f1f2e8994e9ab749685edabe182f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:11.411188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:11.413108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:11.416732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1059/2103] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:11 2022] DELETE /identity/v3/users/f4b7f1f2e8994e9ab749685edabe182f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:11.518297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1045/2104] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:11.520765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.521202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.522059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.546579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:11.548939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:11.569225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1060/2105] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:11.572789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.590280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7ec1d-cf86-4d00-a74e-97a5d9dd8e1d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.599222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.601440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.602859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.603459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.605672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:11.606359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.612496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.638036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1046/2106] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:11.642913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.659915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee150e75-2e99-4020-91c3-86095444b8fe None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.665579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.666268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.667027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.667027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.667562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.669918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.707046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1061/2107] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:11 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:11.712301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.723735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3f430-7e06-4df3-87ff-fab574b2ab49 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.791340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.795572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:11.812899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.813543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.813903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.814277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.815276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.817439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.848052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:11.859833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1047/2108] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:11 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:34:11.861571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.872469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9b377-af7a-4151-9c67-70e57fa3c16b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.877588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.878762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.879054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.884606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.884606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.884606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.897399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1048/2109] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:11.901764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.912115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a360f8-ab98-4495-bf3f-2118bff07d18 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.913120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4264-1fd7-4ed3-ae94-34c5d198d708 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.917702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.918500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.918834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.919123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.919378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.919567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] PATH_INFO: `/v3/projects/767476d7cad14bf2a83b40c4cb975d58` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.919862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.920214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.920637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767476d7cad14bf2a83b40c4cb975d58)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.921078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.922575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.922827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:11.935146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1049/2110] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:11.939642 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:11.953039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746b7e7-5d60-4814-b3d3-647a3fd8bfbc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:11.959396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41144669-6ec4-4e67-b0ee-cfbcf3dde851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:11.960410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41144669-6ec4-4e67-b0ee-cfbcf3dde851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:11.960700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41144669-6ec4-4e67-b0ee-cfbcf3dde851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:11.960949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41144669-6ec4-4e67-b0ee-cfbcf3dde851 admin admin] PATH_INFO: `/v3/projects/c2a75e70ceff4ee98719059c85836bf4/users/4b8dd4e868844ef0acfa56841d58e6b5/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:11.988215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41144669-6ec4-4e67-b0ee-cfbcf3dde851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a75e70ceff4ee98719059c85836bf4, user_id=4b8dd4e868844ef0acfa56841d58e6b5, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:11.991528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41144669-6ec4-4e67-b0ee-cfbcf3dde851 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.007442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767476d7cad14bf2a83b40c4cb975d58', 'request_id': 'req-7b803614-1af2-451d-81fc-0256021cc967'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:12.009081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1050/2111] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:11 2022] PUT /identity/v3/projects/c2a75e70ceff4ee98719059c85836bf4/users/4b8dd4e868844ef0acfa56841d58e6b5/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:12.026186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.026712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.027256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.028709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767476d7cad14bf2a83b40c4cb975d58', 'request_id': 'req-7b803614-1af2-451d-81fc-0256021cc967'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:12.043272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767476d7cad14bf2a83b40c4cb975d58', 'request_id': 'req-7b803614-1af2-451d-81fc-0256021cc967'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:12.045907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:12.064929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] The token cache is being invalidate because project 767476d7cad14bf2a83b40c4cb975d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:12.065253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:12.066176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7b803614-1af2-451d-81fc-0256021cc967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:12.069312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1062/2112] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:11 2022] DELETE /identity/v3/projects/767476d7cad14bf2a83b40c4cb975d58 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:12.081061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] MFA Rules not processed for user `4b8dd4e868844ef0acfa56841d58e6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:12.081320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789cc5b-8ede-4ca5-8577-3360fad18c18 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.081704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789cc5b-8ede-4ca5-8577-3360fad18c18 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.082095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789cc5b-8ede-4ca5-8577-3360fad18c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.082340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:12.103716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4789cc5b-8ede-4ca5-8577-3360fad18c18 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:12.104950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4789cc5b-8ede-4ca5-8577-3360fad18c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:12.229477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1051/2113] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:12.243661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.247541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1063/2114] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:12.247933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:12.261087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.261608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.262306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.284820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:12.286389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:12.302003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1064/2115] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:12.303567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.314011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807abb-06a3-4f72-8d19-c7780f0b3919 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.319205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.320078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.320374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.320655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.321520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:12.321830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.324027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.347471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1065/2116] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:34:12.348708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.355836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c03b2-77ab-4af8-be2c-ad62adc08674 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.360394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.361098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.361417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.361734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.363677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b27b3-b45b-47f6-a36e-0b39cc6fa654 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.372166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.372869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.373204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.373488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.376819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.378049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.379098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.379876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.393472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1052/2117] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:12.414127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1066/2118] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:12.421159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.444345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122426f2-107b-4646-a335-43b1968e1139 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.515682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:12.535497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.536243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.536557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.537379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.538095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.540228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.563509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1053/2119] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:12.568710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.583741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0589478-a335-44ae-8cd2-cdbb1bea4300 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.591759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.592829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.593365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.593865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.595521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.599964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.617736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1067/2120] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:12.622773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.641911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e8400-7676-4293-bbe7-8f302d9f261a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.653166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17d243-8647-4b8a-b63b-b3b6a7bc5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.654659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17d243-8647-4b8a-b63b-b3b6a7bc5fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.655248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17d243-8647-4b8a-b63b-b3b6a7bc5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.655971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17d243-8647-4b8a-b63b-b3b6a7bc5fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.657931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17d243-8647-4b8a-b63b-b3b6a7bc5fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.660877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17d243-8647-4b8a-b63b-b3b6a7bc5fdb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.686384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1054/2121] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:12.687593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:12.698999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965e1a9-644c-4454-bb85-b84857a32d49 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:12.709707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:12.710760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.711159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.712487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] PATH_INFO: `/v3/projects/20c49a8139ab4e2699c365acea6dc8d5/users/9895ac0de76e468982354a2b6bddf3c5/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.735303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c49a8139ab4e2699c365acea6dc8d5, user_id=9895ac0de76e468982354a2b6bddf3c5, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:12.738506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:12.763683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1068/2122] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:12 2022] PUT /identity/v3/projects/20c49a8139ab4e2699c365acea6dc8d5/users/9895ac0de76e468982354a2b6bddf3c5/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:12.774667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:12.774994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:12.775307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:12.818370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] MFA Rules not processed for user `9895ac0de76e468982354a2b6bddf3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:12.820524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:12.928084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1055/2123] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:12.933036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.016845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9069-8c90-45b1-b40d-fdc4b1c17f89 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.022750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.023537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.023920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.024207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.024968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.026910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.048830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:13.056734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1069/2124] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:12 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:13.061424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.075213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38ff18-0f10-4a28-ba06-823b214a4608 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.145239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.145954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.146802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.147082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.148001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.151361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.185664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1056/2125] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:13 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:13.186892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.200081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe7bf3-cf6a-40c0-88f2-4786d26dd131 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.211834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.212715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.213012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.213301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.214063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.215757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.233013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1070/2126] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:13.234670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.246929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ef35e-92b8-4089-8482-4284ed60bde7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.259983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecbbec-3c60-4cb7-b7f7-618a51fa7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.261315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbbec-3c60-4cb7-b7f7-618a51fa7cde admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.261922 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbbec-3c60-4cb7-b7f7-618a51fa7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.262229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbbec-3c60-4cb7-b7f7-618a51fa7cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.265302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecbbec-3c60-4cb7-b7f7-618a51fa7cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.265770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecbbec-3c60-4cb7-b7f7-618a51fa7cde admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.280468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1057/2127] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:13.287671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.304663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216c85-78e9-470c-9729-c85c70bad953 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.311173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.312395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.312696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.313016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] PATH_INFO: `/v3/projects/bbd1a56f6a1744c9b4241e46b080873e/users/d64c20f7251c487794e5f7fade0c09e9/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.337600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd1a56f6a1744c9b4241e46b080873e, user_id=d64c20f7251c487794e5f7fade0c09e9, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.341132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.360471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1071/2128] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:13 2022] PUT /identity/v3/projects/bbd1a56f6a1744c9b4241e46b080873e/users/d64c20f7251c487794e5f7fade0c09e9/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:13.372221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.372824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.373178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.408146 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] MFA Rules not processed for user `d64c20f7251c487794e5f7fade0c09e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:13.410471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:13.445804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:13.511447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1058/2129] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:13.511807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.513835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:13.516785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.598204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0389-d56c-417b-b6eb-a41d6d525122 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.604972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.605677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.606009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.606414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.608307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:13.611098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042ad0-7d26-483b-b38a-604cb55e53ee None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.616716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.617485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.618089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.618582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.620335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.623274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.656960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1059/2130] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:13 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:34:13.663815 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.695482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.697419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.711576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1072/2131] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:13.745845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8528-e8a7-4032-8bb7-e5f268a0bf67 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.750726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.751516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.751975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.752260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.752995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.755911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.782833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1060/2132] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:13 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:34:13.788804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.803606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72959dc-effb-4e2f-81e8-f9b089b6bae8 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.812952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.814406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.814881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.815348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.816691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.820360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.843490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1073/2133] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:13.844697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.856661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a7d35-3bd3-4ce5-a2bd-2562e5c9e80d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:13.864676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:13.865803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:13.865977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:13.866272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] PATH_INFO: `/v3/projects/7de68b396aba45a2a6bb789de14b6e7b/users/862dcc24c0294243b5f652f88178a35c/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:13.884379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de68b396aba45a2a6bb789de14b6e7b, user_id=862dcc24c0294243b5f652f88178a35c, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:13.887112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:13.909358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1061/2134] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:13 2022] PUT /identity/v3/projects/7de68b396aba45a2a6bb789de14b6e7b/users/862dcc24c0294243b5f652f88178a35c/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:13.914263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:13.928924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2335a63-afd6-41ac-8ce8-6b961696446d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:14.016921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c945f1-5de0-450c-b448-fdb63e0ca703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:14.018614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c945f1-5de0-450c-b448-fdb63e0ca703 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.019107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c945f1-5de0-450c-b448-fdb63e0ca703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.019593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c945f1-5de0-450c-b448-fdb63e0ca703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.020909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c945f1-5de0-450c-b448-fdb63e0ca703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:14.024553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c945f1-5de0-450c-b448-fdb63e0ca703 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:14.032004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:14.045498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:14.046534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1074/2135] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:14.062081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ca94-b71c-4690-b507-8994581843aa admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:14.076054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:14.078466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.078975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.079499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] PATH_INFO: `/v3/projects/7de68b396aba45a2a6bb789de14b6e7b/users/862dcc24c0294243b5f652f88178a35c/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.086459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de68b396aba45a2a6bb789de14b6e7b, user_id=862dcc24c0294243b5f652f88178a35c, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:14.091816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:14.100031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:14.108819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1062/2136] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:14 2022] PUT /identity/v3/projects/7de68b396aba45a2a6bb789de14b6e7b/users/862dcc24c0294243b5f652f88178a35c/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:14.118369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.118688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.118973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.162892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] MFA Rules not processed for user `862dcc24c0294243b5f652f88178a35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:14.165171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:14.313433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1075/2137] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:14.332474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:14.392812 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:14.395108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:14.438199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733bc3-5c5c-4f17-a379-731910e2bdc7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:14.444247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35f08-a867-4b2a-a225-8308c523bff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:14.445282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35f08-a867-4b2a-a225-8308c523bff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.445944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35f08-a867-4b2a-a225-8308c523bff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.447246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35f08-a867-4b2a-a225-8308c523bff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.468007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d35f08-a867-4b2a-a225-8308c523bff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:14.470427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d35f08-a867-4b2a-a225-8308c523bff9 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:14.487845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1063/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:14.509448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e531587-1ffa-4bf1-8f3e-ffa23a48183c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:14.515863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:14.517033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.517545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.518064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] PATH_INFO: `/v3/users/5cf5cbd741e74bc0941c9d7b535fd979` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.519560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf5cbd741e74bc0941c9d7b535fd979)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:14.522612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:14.593980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf5cbd741e74bc0941c9d7b535fd979'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:14.594664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf5cbd741e74bc0941c9d7b535fd979'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:14.606218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf5cbd741e74bc0941c9d7b535fd979'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:14.622437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf5cbd741e74bc0941c9d7b535fd979'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:14.626004 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf5cbd741e74bc0941c9d7b535fd979'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:14.641681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1076/2139] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:14 2022] DELETE /identity/v3/users/5cf5cbd741e74bc0941c9d7b535fd979 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:14.646291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.646582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.646869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.668084 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:14.669382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:14.745228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1064/2140] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:14.755796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:14.757417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:14.764409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:14.825034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d345e1-c72f-4cb6-9933-fe19d13e1363 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:14.828982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:14.829734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:14.830037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:14.830370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:14.841318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:14.843116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:14.857090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1077/2141] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:15.121442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.123059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:15.194345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721812-7d78-4668-8cbb-a1c03ad3ea85 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.198120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.198791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.199223 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.199814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.201240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.201696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:15.202770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:15.223461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f539a-1025-4eb5-9ca0-f749ef6e2a01 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.229359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.230227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.230506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.230782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] PATH_INFO: `/v3/projects/cfd3080e7d454b5b90b9187576fc96cf` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.232691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd3080e7d454b5b90b9187576fc96cf)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.234649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.281028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.282563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56388afc-fe6d-442d-aac8-1793f28bb8c4 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.286559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:15.294752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1065/2142] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:15.312793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd3080e7d454b5b90b9187576fc96cf', 'request_id': 'req-719dd7c8-366d-44b9-9b5a-0c189d74569b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:15.320842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd3080e7d454b5b90b9187576fc96cf', 'request_id': 'req-719dd7c8-366d-44b9-9b5a-0c189d74569b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:15.328314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd3080e7d454b5b90b9187576fc96cf', 'request_id': 'req-719dd7c8-366d-44b9-9b5a-0c189d74569b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:15.348494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] The token cache is being invalidate because project cfd3080e7d454b5b90b9187576fc96cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:15.348788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:15.349473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-719dd7c8-366d-44b9-9b5a-0c189d74569b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:15.354419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1078/2143] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:15 2022] DELETE /identity/v3/projects/cfd3080e7d454b5b90b9187576fc96cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:15.356538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.356979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.358229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.381359 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:15.382466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:15.477957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1066/2144] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:15.486857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.487145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.488236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.517001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:15.518390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:15.534340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1079/2145] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:15.538649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.556720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aac2b-c8e1-4019-9507-5730571e06b3 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.570450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.571843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.572734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.573634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.576297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:15.578324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.582773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.605574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1067/2146] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:15.610987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.625933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a39bf3-6800-493f-9dab-476d8bab6e8d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.635408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.636611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.637083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.637770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.640772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.643905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.705202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1080/2147] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:15 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:15.706524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.732768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a193f50-0bcc-4cc0-a6f7-0eb393d509bb admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.846713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.847519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.847942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.848232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.848976 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.851504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.875383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1068/2148] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:15 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:15.879634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.890740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73304304-0861-4a0f-8b90-8961f8cf8168 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.895660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.896876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.897159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.897436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.898178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.899865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.912752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1081/2149] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:15.916578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.931766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7500-0072-4f3b-b40e-ddb30ed43d37 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.936387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414465-4bab-4789-ae8b-d7933da3c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.937277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414465-4bab-4789-ae8b-d7933da3c12f admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.937630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414465-4bab-4789-ae8b-d7933da3c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.938089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414465-4bab-4789-ae8b-d7933da3c12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:15.938839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414465-4bab-4789-ae8b-d7933da3c12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:15.940578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414465-4bab-4789-ae8b-d7933da3c12f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:15.952402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1069/2150] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:15.966002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:15.980029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847309-3ca9-4e07-9895-87ecaa60c05e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:15.989104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:15.990357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:15.990780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:15.991076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] PATH_INFO: `/v3/projects/cd8e91f8239a4766b578ffdd183babe6/users/1c458eafafcc4790b1fe6dadfa1d5218/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:16.024921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8e91f8239a4766b578ffdd183babe6, user_id=1c458eafafcc4790b1fe6dadfa1d5218, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:16.028945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:16.047089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1082/2151] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:15 2022] PUT /identity/v3/projects/cd8e91f8239a4766b578ffdd183babe6/users/1c458eafafcc4790b1fe6dadfa1d5218/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:16.058457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:16.058955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:16.059244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:16.094230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] MFA Rules not processed for user `1c458eafafcc4790b1fe6dadfa1d5218`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:16.095511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:16.164959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:16.177584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1070/2152] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:16.189437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:16.191175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:16.230463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:16.264827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee5af8-a2aa-4f73-bedd-b50c821b99c9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:16.268534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:16.269263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:16.269496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:16.269782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:16.279365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:16.280902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:16.290065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1083/2153] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:19.836131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:19.837733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:19.849962 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a280cd-6d1c-418b-828d-23f924d4fa6b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:19.853594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:19.854258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:19.854567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:19.854839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:19.858437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:19.936838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:19.938498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bad98a-baed-437a-9c76-25671f27e2a8 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:19.950802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1071/2154] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:22.290994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:22.293675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:22.423160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f86bc-fbcb-4d5b-bb20-ced1683817a4 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:22.429787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:22.430966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:22.431280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:22.431565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] PATH_INFO: `/v3/users/9895ac0de76e468982354a2b6bddf3c5` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:22.432906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9895ac0de76e468982354a2b6bddf3c5)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:22.436562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:22.491123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9895ac0de76e468982354a2b6bddf3c5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:22.492157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9895ac0de76e468982354a2b6bddf3c5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:22.500545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9895ac0de76e468982354a2b6bddf3c5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:22.515905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9895ac0de76e468982354a2b6bddf3c5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:22.516517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9895ac0de76e468982354a2b6bddf3c5'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:22.529426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1084/2155] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:22 2022] DELETE /identity/v3/users/9895ac0de76e468982354a2b6bddf3c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:22.534272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:22.534823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:22.534823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:22.557065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:22.558550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:22.629541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1072/2156] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:22.641389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:22.643057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:22.734409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:22.739054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f52d-55b1-481b-ae38-9d9655988a8e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:22.744702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:22.745840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:22.746204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:22.746498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:22.767157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:22.770529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:22.787762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1085/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:23.183354 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:23.185809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:23.205492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922d9d-4aeb-4645-84eb-c8dbdf9cfc08 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:23.212584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:23.213968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:23.214464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:23.214945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] PATH_INFO: `/v3/projects/20c49a8139ab4e2699c365acea6dc8d5` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:23.218037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c49a8139ab4e2699c365acea6dc8d5)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:23.221456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:23.284428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c49a8139ab4e2699c365acea6dc8d5', 'request_id': 'req-535db440-4dde-479c-9d5e-161c2c9e4faa'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.291027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c49a8139ab4e2699c365acea6dc8d5', 'request_id': 'req-535db440-4dde-479c-9d5e-161c2c9e4faa'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.298305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c49a8139ab4e2699c365acea6dc8d5', 'request_id': 'req-535db440-4dde-479c-9d5e-161c2c9e4faa'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.314353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] The token cache is being invalidate because project 20c49a8139ab4e2699c365acea6dc8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:23.314650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.315316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.317125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1073/2158] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:23 2022] DELETE /identity/v3/projects/20c49a8139ab4e2699c365acea6dc8d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:23.321821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:23.332574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d090a5-de8a-46c8-b91d-1c760b67625b service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:23.373834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:23.375546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:23.403214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:23.458192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:23.459919 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:23.460671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:23.461177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] PATH_INFO: `/v3/users/d64c20f7251c487794e5f7fade0c09e9` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:23.466262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64c20f7251c487794e5f7fade0c09e9)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:23.470589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:23.501449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db440-4dde-479c-9d5e-161c2c9e4faa admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:23.512671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:23.513730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:23.514456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:23.514739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] PATH_INFO: `/v3/users/4b8dd4e868844ef0acfa56841d58e6b5` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:23.516485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8dd4e868844ef0acfa56841d58e6b5)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:23.519124 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:23.559522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64c20f7251c487794e5f7fade0c09e9'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.560300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64c20f7251c487794e5f7fade0c09e9'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.574013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64c20f7251c487794e5f7fade0c09e9'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.593532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64c20f7251c487794e5f7fade0c09e9'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.594008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8dd4e868844ef0acfa56841d58e6b5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.595485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8dd4e868844ef0acfa56841d58e6b5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.596223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b10e00f7-1ed0-4b11-a9a4-66f7266a9b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64c20f7251c487794e5f7fade0c09e9'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.609145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8dd4e868844ef0acfa56841d58e6b5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.616458 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1086/2159] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:23 2022] DELETE /identity/v3/users/d64c20f7251c487794e5f7fade0c09e9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:23.638119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8dd4e868844ef0acfa56841d58e6b5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.648155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8dd4e868844ef0acfa56841d58e6b5'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:23.669947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1074/2160] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:23 2022] DELETE /identity/v3/users/4b8dd4e868844ef0acfa56841d58e6b5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:23.674733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:23.675084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:23.675709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:23.694923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:23.696414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:23.775141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1087/2161] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:23.788573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:23.790530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:23.884398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab0e88-631a-49c8-89cd-25d3a9f2187f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:23.888671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:23.889801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:23.890085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:23.890545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:23.909190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:23.915766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:23.929992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1075/2162] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:24.027155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:24.029116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:24.048358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506585a-5391-4272-b648-e27e3dcb58d9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:24.053450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:24.054525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.054745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.055054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] PATH_INFO: `/v3/projects/bbd1a56f6a1744c9b4241e46b080873e` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.056483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd1a56f6a1744c9b4241e46b080873e)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:24.058777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:24.068031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:24.154021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd1a56f6a1744c9b4241e46b080873e', 'request_id': 'req-618de2f7-895e-4597-8aba-80c511857957'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.168697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd1a56f6a1744c9b4241e46b080873e', 'request_id': 'req-618de2f7-895e-4597-8aba-80c511857957'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.179835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd1a56f6a1744c9b4241e46b080873e', 'request_id': 'req-618de2f7-895e-4597-8aba-80c511857957'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.212676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] The token cache is being invalidate because project bbd1a56f6a1744c9b4241e46b080873e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:24.213526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.215387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.218593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1088/2163] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:24 2022] DELETE /identity/v3/projects/bbd1a56f6a1744c9b4241e46b080873e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:24.222971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:24.243268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc6ae4-8dbf-4e98-a86b-901f49e51d89 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:24.294379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:24.348186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:24.349888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.350168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.350444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] PATH_INFO: `/v3/users/862dcc24c0294243b5f652f88178a35c` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.351968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862dcc24c0294243b5f652f88178a35c)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:24.354879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:24.453187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862dcc24c0294243b5f652f88178a35c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.455393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862dcc24c0294243b5f652f88178a35c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.479277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862dcc24c0294243b5f652f88178a35c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.522470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862dcc24c0294243b5f652f88178a35c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.538175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:24.542237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:24.588384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de2f7-895e-4597-8aba-80c511857957 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:24.588707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0dc4224c-3d93-45a5-bff2-f0edfe89a3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862dcc24c0294243b5f652f88178a35c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.603475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:24.605687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.606585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.607497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] PATH_INFO: `/v3/projects/c2a75e70ceff4ee98719059c85836bf4` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.609624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1076/2164] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:24 2022] DELETE /identity/v3/users/862dcc24c0294243b5f652f88178a35c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:24.612134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a75e70ceff4ee98719059c85836bf4)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:24.616836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:24.701390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a75e70ceff4ee98719059c85836bf4', 'request_id': 'req-4244bbdc-8822-4c17-923a-844b2c905213'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.711542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a75e70ceff4ee98719059c85836bf4', 'request_id': 'req-4244bbdc-8822-4c17-923a-844b2c905213'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.723406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a75e70ceff4ee98719059c85836bf4', 'request_id': 'req-4244bbdc-8822-4c17-923a-844b2c905213'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.746604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] The token cache is being invalidate because project c2a75e70ceff4ee98719059c85836bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:24.748098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.749445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4244bbdc-8822-4c17-923a-844b2c905213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:24.752223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1089/2165] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:24 2022] DELETE /identity/v3/projects/c2a75e70ceff4ee98719059c85836bf4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:24.757693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.757980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.758255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.781497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:24.782771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:24.859664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1077/2166] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:24.865934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.866423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.866865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.897364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:24.899929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:24.923312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1090/2167] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:24.928210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:24.939819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801faf-81bf-42b3-a3e4-40ae4dccf523 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:24.949252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:24.949252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.949252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.949252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.950356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:24.950719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:24.952531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:24.971679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1078/2168] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:34:24.973839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:24.991073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4dca8-03dc-4bcc-985b-1b0d59e35c15 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:24.997533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:24.998218 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:24.998555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:24.999020 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:24.999979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.001928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.007047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.010115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.029905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f253-50a0-4780-a458-d086705316b6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.037770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.038836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.039167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.039974 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] PATH_INFO: `/v3/projects/7de68b396aba45a2a6bb789de14b6e7b` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.040977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de68b396aba45a2a6bb789de14b6e7b)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.043202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.046714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1091/2169] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:24 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:25.049943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.098321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:25.109140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de68b396aba45a2a6bb789de14b6e7b', 'request_id': 'req-3c0e9785-ca5c-4028-b7c8-999a71e771b4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:25.117190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de68b396aba45a2a6bb789de14b6e7b', 'request_id': 'req-3c0e9785-ca5c-4028-b7c8-999a71e771b4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:25.124992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de68b396aba45a2a6bb789de14b6e7b', 'request_id': 'req-3c0e9785-ca5c-4028-b7c8-999a71e771b4'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:25.127648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:25.148352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] The token cache is being invalidate because project 7de68b396aba45a2a6bb789de14b6e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:25.148659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:25.149389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3c0e9785-ca5c-4028-b7c8-999a71e771b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:25.155650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1079/2170] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:25 2022] DELETE /identity/v3/projects/7de68b396aba45a2a6bb789de14b6e7b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:25.156177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb0cb-2c1c-4905-8965-9a8aeecf8b6e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.159658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.159658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.159967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.183432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:25.184785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.241188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465a5ca-74f8-491e-b316-c54d472a3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.242161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465a5ca-74f8-491e-b316-c54d472a3275 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.242161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465a5ca-74f8-491e-b316-c54d472a3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.243937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465a5ca-74f8-491e-b316-c54d472a3275 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.245133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465a5ca-74f8-491e-b316-c54d472a3275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.246897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465a5ca-74f8-491e-b316-c54d472a3275 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.269483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1080/2171] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:25.275449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1092/2172] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:25.276651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.278320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.282529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.282829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.283106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.292044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cafd8-862b-4efc-b2d7-36966869a5a8 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.296853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.297545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.297831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.298113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.298862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.300573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.303811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:25.305042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.312912 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1081/2173] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:25.313424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1093/2174] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:25.316901 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.317278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.328029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57557-f1a0-4607-a5f0-4373f42a9af7 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.330019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770bc7-690e-4d86-8415-80790ae8b714 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.333130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.333831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.334113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.334392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.334834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.335121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:25.335427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.335524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.335810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.336093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.336821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.337265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.338435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.350497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1094/2175] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:34:25.351263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1082/2176] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:25.355054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.355247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.366758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188043d4-cc74-441b-b854-69659ecc0ebf admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.367028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb225a-faa9-4e36-b3bc-773442c2b434 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.371867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975cdde-739e-4b70-a628-0180cefd2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.372021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.372610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.372836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975cdde-739e-4b70-a628-0180cefd2baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.372944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.373148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975cdde-739e-4b70-a628-0180cefd2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.373247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.373423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975cdde-739e-4b70-a628-0180cefd2baf admin admin] PATH_INFO: `/v3/projects/6ac1676d0e514554a7cafab072f2a119/users/10919eea11f3411ead1facfe3e37bf6d/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.373844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.375816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.390672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975cdde-739e-4b70-a628-0180cefd2baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac1676d0e514554a7cafab072f2a119, user_id=10919eea11f3411ead1facfe3e37bf6d, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.393386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975cdde-739e-4b70-a628-0180cefd2baf admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.406862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1095/2177] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:25.407870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1083/2178] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:25 2022] PUT /identity/v3/projects/6ac1676d0e514554a7cafab072f2a119/users/10919eea11f3411ead1facfe3e37bf6d/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:25.411086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.412935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.413233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.413657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.434111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:25.435344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.485147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75d86c-b9ea-40aa-b838-02e7c092f0bc admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.492625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.493308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.493765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.494058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.494763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.497798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.515509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1084/2179] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:25.528087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1096/2180] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:25.532884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.535819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.537605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.549200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13bad-6ac1-475a-abe4-bd7d11ad400b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.559129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.560339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.560988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.561410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.562319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.564351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.571292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:25.576675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1097/2181] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:25.603469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.627860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0a893-07f4-4642-a5d7-02056ee10ae2 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.631228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11513e5e-b449-45a7-859d-fcc108485244 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.636674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.638043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.638974 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.639550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.644706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5193c93-4bad-41d0-8b78-0c2552721cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.645420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193c93-4bad-41d0-8b78-0c2552721cda admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.645789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193c93-4bad-41d0-8b78-0c2552721cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.646118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193c93-4bad-41d0-8b78-0c2552721cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.646949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5193c93-4bad-41d0-8b78-0c2552721cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.648716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5193c93-4bad-41d0-8b78-0c2552721cda admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.653619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.656006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.679418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1085/2182] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:25.687661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1098/2183] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:25.692385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.703401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad211860-5da4-4630-878b-7d5b556c0756 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:25.716551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:25.718078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.718562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.719069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] PATH_INFO: `/v3/projects/0acbede9739c43cba0a9071abe387837/users/a9c3307d1ae5495ea2d0790eb39e3b48/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.749100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acbede9739c43cba0a9071abe387837, user_id=a9c3307d1ae5495ea2d0790eb39e3b48, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:25.754056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:25.776013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1086/2184] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:25 2022] PUT /identity/v3/projects/0acbede9739c43cba0a9071abe387837/users/a9c3307d1ae5495ea2d0790eb39e3b48/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:25.782391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff63604-41bf-454b-a768-794658aa7f26 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:25.782922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff63604-41bf-454b-a768-794658aa7f26 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:25.783432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff63604-41bf-454b-a768-794658aa7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:25.815326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2ff63604-41bf-454b-a768-794658aa7f26 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:25.817145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2ff63604-41bf-454b-a768-794658aa7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:25.825924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:25.924360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1099/2185] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:25.937616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:25.939557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:26.028244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf14e4-e55a-41e6-972f-80ba82b9381d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:26.033090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:26.034163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:26.034448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:26.034775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:26.045305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:26.046766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:26.058646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1087/2186] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:27.363352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:27.363970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:27.363970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:27.395103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] MFA Rules not processed for user `a9c3307d1ae5495ea2d0790eb39e3b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:27.396638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:27.479218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:27.481782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:27.497209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ed937-4b60-4df3-9ff3-02193c76c638 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:27.504148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:27.505357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:27.505822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:27.506276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] PATH_INFO: `/v3/users/1605acdcf27644039e06ae976342f68c` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:27.507796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1605acdcf27644039e06ae976342f68c)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:27.509856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:27.511232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1100/2187] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:27.524468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:27.526794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:27.609995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d01714-4ed8-4a12-9371-06edb00159f6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:27.612693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1605acdcf27644039e06ae976342f68c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:27.614085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1605acdcf27644039e06ae976342f68c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:27.615084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7897e2-99e5-4e61-8696-40a07623d84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:27.615966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7897e2-99e5-4e61-8696-40a07623d84d service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:27.616250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7897e2-99e5-4e61-8696-40a07623d84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:27.616517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7897e2-99e5-4e61-8696-40a07623d84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:27.628382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7897e2-99e5-4e61-8696-40a07623d84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:27.628741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1605acdcf27644039e06ae976342f68c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:27.631654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7897e2-99e5-4e61-8696-40a07623d84d service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:27.651830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1101/2188] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:27.667171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1605acdcf27644039e06ae976342f68c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:27.680119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1605acdcf27644039e06ae976342f68c'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:27.692268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1088/2189] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:27 2022] DELETE /identity/v3/users/1605acdcf27644039e06ae976342f68c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:27.694251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:27.694389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:27.694702 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:27.717959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:27.719688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:27.769637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:27.802813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1102/2190] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:27.810530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:27.812545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:27.862951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:27.957854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061451-1fba-4a80-9871-a76a973c9554 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:27.965759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93de87-2558-4dc0-9205-923d471111a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:27.966940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93de87-2558-4dc0-9205-923d471111a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:27.967442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93de87-2558-4dc0-9205-923d471111a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:27.968017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93de87-2558-4dc0-9205-923d471111a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:27.988555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93de87-2558-4dc0-9205-923d471111a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:27.991374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93de87-2558-4dc0-9205-923d471111a6 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:28.031004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1089/2191] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:28.505968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:28.510495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:28.535526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4ea23-9e10-4ba6-b8f0-bdfe00a49b47 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:28.545597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:28.546588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:28.546943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:28.547309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] PATH_INFO: `/v3/users/1c458eafafcc4790b1fe6dadfa1d5218` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:28.548903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c458eafafcc4790b1fe6dadfa1d5218)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:28.551138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:28.659359 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c458eafafcc4790b1fe6dadfa1d5218'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:28.660243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c458eafafcc4790b1fe6dadfa1d5218'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:28.669534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c458eafafcc4790b1fe6dadfa1d5218'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:28.699129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c458eafafcc4790b1fe6dadfa1d5218'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:28.701415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c458eafafcc4790b1fe6dadfa1d5218'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:28.724978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1103/2192] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:28 2022] DELETE /identity/v3/users/1c458eafafcc4790b1fe6dadfa1d5218 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:28.732921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:28.733455 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:28.733966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:28.744000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:28.753571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:28.776578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:28.778799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:28.909640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1090/2193] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:28.923534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:28.923790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3f200-f6ca-49f7-be7b-856e5bfd942c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:28.925579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:28.930809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:28.931746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:28.932059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:28.932348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] PATH_INFO: `/v3/projects/d6d6e4ab04cf48d78e07d4f1ed28b04b` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:28.933757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d6e4ab04cf48d78e07d4f1ed28b04b)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:28.936269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:29.015603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77b14-9924-417c-8b3d-b56a048f2b15 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:29.025678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d6e4ab04cf48d78e07d4f1ed28b04b', 'request_id': 'req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.033164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d6e4ab04cf48d78e07d4f1ed28b04b', 'request_id': 'req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.035152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:29.043157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d6e4ab04cf48d78e07d4f1ed28b04b', 'request_id': 'req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.065824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] The token cache is being invalidate because project d6d6e4ab04cf48d78e07d4f1ed28b04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:29.067033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.068276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.071027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1104/2194] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:28 2022] DELETE /identity/v3/projects/d6d6e4ab04cf48d78e07d4f1ed28b04b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:29.075666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:29.077276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:29.093823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:29.095790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:29.095790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:29.095790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:29.097629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:29.148329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:29.165203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca428c01-fb3e-407b-b407-bfe3fe2fe7ef admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:29.169340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:29.170249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:29.170524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:29.170804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] PATH_INFO: `/v3/users/a3d561c1549c40ad8bdf038e5c6f0517` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:29.172139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d561c1549c40ad8bdf038e5c6f0517)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:29.174168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:29.197959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:29.200881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c6f1c-56b8-43a1-bc97-c547631d1001 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:29.229735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1091/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:29.285487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d561c1549c40ad8bdf038e5c6f0517'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.287681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d561c1549c40ad8bdf038e5c6f0517'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.300650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d561c1549c40ad8bdf038e5c6f0517'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.330688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d561c1549c40ad8bdf038e5c6f0517'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.332447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d561c1549c40ad8bdf038e5c6f0517'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:29.344043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454f388-00d1-44fb-b792-28dc84c08c24 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:29.344357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454f388-00d1-44fb-b792-28dc84c08c24 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:29.344643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454f388-00d1-44fb-b792-28dc84c08c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:29.373701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1105/2196] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:29 2022] DELETE /identity/v3/users/a3d561c1549c40ad8bdf038e5c6f0517 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:29.380697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b454f388-00d1-44fb-b792-28dc84c08c24 None None] MFA Rules not processed for user `a9c3307d1ae5495ea2d0790eb39e3b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:29.382693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b454f388-00d1-44fb-b792-28dc84c08c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:29.501324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1092/2197] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:30.045212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:30.046819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:30.209034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083717a-9b6f-451f-9a64-e5fa0429f20d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:30.223144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:30.225831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:30.225831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:30.228615 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] PATH_INFO: `/v3/projects/cd8e91f8239a4766b578ffdd183babe6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:30.233059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8e91f8239a4766b578ffdd183babe6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:30.241850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:30.257987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:30.364071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8e91f8239a4766b578ffdd183babe6', 'request_id': 'req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:30.383671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8e91f8239a4766b578ffdd183babe6', 'request_id': 'req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:30.392897 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8e91f8239a4766b578ffdd183babe6', 'request_id': 'req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:30.442388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] The token cache is being invalidate because project cd8e91f8239a4766b578ffdd183babe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:30.443482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:30.444694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:30.449838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1106/2198] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:30 2022] DELETE /identity/v3/projects/cd8e91f8239a4766b578ffdd183babe6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:30.455853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268d00-c0ba-4404-81cb-e70a53d98cc4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:30.456771 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268d00-c0ba-4404-81cb-e70a53d98cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:30.457209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268d00-c0ba-4404-81cb-e70a53d98cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:30.521475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-3f268d00-c0ba-4404-81cb-e70a53d98cc4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:30.525249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3f268d00-c0ba-4404-81cb-e70a53d98cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:30.597440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:30.599877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:30.730609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1093/2199] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:30.740797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525402-5385-4213-b4fd-5a026effc810 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:30.741273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525402-5385-4213-b4fd-5a026effc810 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:30.741803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525402-5385-4213-b4fd-5a026effc810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:30.793405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc1b2d-7c65-43b5-9aa8-134d544d214e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:30.806816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-47525402-5385-4213-b4fd-5a026effc810 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:30.807973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:30.811402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:30.811746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:30.812806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] PATH_INFO: `/v3/projects/d79dc2f361314ea6afbe595c6d8e83c6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:30.817193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79dc2f361314ea6afbe595c6d8e83c6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:30.817828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-47525402-5385-4213-b4fd-5a026effc810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:30.822425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:30.860377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1094/2200] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:30.867185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525402-5385-4213-b4fd-5a026effc810 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:30.890180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525402-5385-4213-b4fd-5a026effc810 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:30.919791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:30.922599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:30.924148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:30.925266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:30.934105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:30.935386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:30.938937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:30.977888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1095/2201] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:34:30.979841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:30.998565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79dc2f361314ea6afbe595c6d8e83c6', 'request_id': 'req-4eef182f-624e-44f3-b4a4-04d2a186e43f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:31.005843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b819a-5b39-4c45-b520-a6dc197d080e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.011275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79dc2f361314ea6afbe595c6d8e83c6', 'request_id': 'req-4eef182f-624e-44f3-b4a4-04d2a186e43f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:31.029503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79dc2f361314ea6afbe595c6d8e83c6', 'request_id': 'req-4eef182f-624e-44f3-b4a4-04d2a186e43f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:31.087911 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] The token cache is being invalidate because project d79dc2f361314ea6afbe595c6d8e83c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:31.088561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:31.091647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4eef182f-624e-44f3-b4a4-04d2a186e43f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:31.103376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1107/2202] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:30 2022] DELETE /identity/v3/projects/d79dc2f361314ea6afbe595c6d8e83c6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:31.111122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0f29a-53fd-4c77-afc6-0274ca53b8ea None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.112655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0f29a-53fd-4c77-afc6-0274ca53b8ea None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.113031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0f29a-53fd-4c77-afc6-0274ca53b8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.151740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:31.175368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9af0f29a-53fd-4c77-afc6-0274ca53b8ea None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:31.177567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9af0f29a-53fd-4c77-afc6-0274ca53b8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:31.180921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.181748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.182078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.182358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.183111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.185095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.201741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1108/2203] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:31.207381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.207722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.208067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.276834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1096/2204] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:30 2022] POST /identity/v3/projects => generated 375 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:31.277829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.280835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:31.283838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:31.284694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:31.333883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:31.492361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1109/2205] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:31.496779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.499093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11d723-d208-49c2-84e4-c5e2e406a774 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.509247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06e500-10ea-450a-8dd0-f397d2b55d68 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.515931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.516687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.517019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.517300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.518214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:31.518530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.520611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.528658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.529898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.530186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.530614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.531996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.537446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.549707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1110/2206] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:31.550928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.570872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98485-50be-42b0-8a01-0609d42df850 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.587143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.588077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.588353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.588449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.593202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.595424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.600424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1097/2207] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:31 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:31.604853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.631534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3ae1b-1f76-415b-8b0d-7a542991e7bf admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.646516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.647483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.647995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.648444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.649957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.652837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.668294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1098/2208] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:31.672713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.676424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1111/2209] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:31 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:31.681420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.705351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c409d2-42f1-4ff3-8e8a-4d3a0c24c154 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.854343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d9ac6-8607-4d8a-8356-ab84150fb268 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.876467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.876828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.877093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.877370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.878072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.881107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.896083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.896083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.896083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.896083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.896566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.897377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.937473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1112/2210] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:31 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:31.939434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.950963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1099/2211] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:31.955858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:31.962525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096159-7eca-44a5-9cb7-b72c90005cd4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:31.976234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:31.976927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:31.977313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:31.977599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:31.978352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:31.980044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:31.983293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e11b78-f67f-41e0-b8fa-dc4242b1f094 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:32.010656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1113/2212] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:32.011770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:32.026199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638bc2d-d734-44c3-a08f-90a83464cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:32.027335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638bc2d-d734-44c3-a08f-90a83464cd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.027731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638bc2d-d734-44c3-a08f-90a83464cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.028064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638bc2d-d734-44c3-a08f-90a83464cd9a admin admin] PATH_INFO: `/v3/projects/5a18927c5b4c46aabaaf9c17b252ed45/users/0bba68bde2ee4ca0b0631b5e9b6c6d3f/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.037372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389fb0a-2aac-47d0-af8d-2b94eb175307 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:32.050153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:32.050819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.051115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.052105 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.052254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:32.053870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:32.067756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638bc2d-d734-44c3-a08f-90a83464cd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a18927c5b4c46aabaaf9c17b252ed45, user_id=0bba68bde2ee4ca0b0631b5e9b6c6d3f, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:32.070858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638bc2d-d734-44c3-a08f-90a83464cd9a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:32.080879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1114/2213] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:32.081885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:32.094691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1100/2214] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:31 2022] PUT /identity/v3/projects/5a18927c5b4c46aabaaf9c17b252ed45/users/0bba68bde2ee4ca0b0631b5e9b6c6d3f/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:32.104595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ffb4-549f-4e82-8347-ab8ddfc7a275 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:32.107114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.107417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.108532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.180104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] MFA Rules not processed for user `0bba68bde2ee4ca0b0631b5e9b6c6d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:32.181728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:32.216150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:32.230358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:32.237560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03247811-9fc6-4b26-aed3-31c9d6fc1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:32.240042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03247811-9fc6-4b26-aed3-31c9d6fc1909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.240042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03247811-9fc6-4b26-aed3-31c9d6fc1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.240042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03247811-9fc6-4b26-aed3-31c9d6fc1909 admin admin] PATH_INFO: `/v3/projects/0e0f6bbd39a045edaa8bd7834b5aad03/users/19387fd70b924ad1a05424c7a0a6e181/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.258959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03247811-9fc6-4b26-aed3-31c9d6fc1909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0f6bbd39a045edaa8bd7834b5aad03, user_id=19387fd70b924ad1a05424c7a0a6e181, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:32.265174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03247811-9fc6-4b26-aed3-31c9d6fc1909 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:32.284694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1115/2215] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:32 2022] PUT /identity/v3/projects/0e0f6bbd39a045edaa8bd7834b5aad03/users/19387fd70b924ad1a05424c7a0a6e181/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:32.306164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.306455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.306742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.347567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1101/2216] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:32.363030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:32.366025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:32.394431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] MFA Rules not processed for user `19387fd70b924ad1a05424c7a0a6e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:32.396416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:32.542862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19595ed9-c9e4-47d9-91b1-28f0219f630c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:32.564334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1116/2217] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:32.571157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:32.778494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:32.778494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.778494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.779016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.830920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437132-5896-4cc8-8aa4-8b126ad5be02 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:32.840777 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:32.841490 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:32.841783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:32.842065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:32.842784 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:32.844808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:32.946175 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1117/2218] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:32 2022] POST /identity/v3/projects => generated 393 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:32.965520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.015564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.018050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.044068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1102/2219] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:33.121122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:33.139595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530d66-bd59-48f7-971a-e46bf1089df3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:33.152945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:33.153836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.154118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.154392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.155102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.162497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.210190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1118/2220] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:32 2022] POST /identity/v3/users => generated 303 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:33.214504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.228930 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48a265-df4b-4c21-bb7a-24b5787afa79 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:33.243540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87702bea-efcb-4ea2-b16b-9881b37170f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:33.244271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87702bea-efcb-4ea2-b16b-9881b37170f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.244560 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87702bea-efcb-4ea2-b16b-9881b37170f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.244870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87702bea-efcb-4ea2-b16b-9881b37170f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.245720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87702bea-efcb-4ea2-b16b-9881b37170f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.247374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87702bea-efcb-4ea2-b16b-9881b37170f2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.276667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1103/2221] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:33.281661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.294670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f653d-c50a-41af-9fab-09ef19c8d42e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:33.306238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:33.311576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.311576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.318148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] PATH_INFO: `/v3/projects/b1f6ac1aa2ae49558179985f2d28b3f1/users/3a785c5fa5094ab1a50a11c3f563cb3e/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.342399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.342756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.343181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.377845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f6ac1aa2ae49558179985f2d28b3f1, user_id=3a785c5fa5094ab1a50a11c3f563cb3e, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.386367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] MFA Rules not processed for user `10919eea11f3411ead1facfe3e37bf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:33.387752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:33.388927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.392883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:33.423313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1119/2222] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:33 2022] PUT /identity/v3/projects/b1f6ac1aa2ae49558179985f2d28b3f1/users/3a785c5fa5094ab1a50a11c3f563cb3e/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:33.428467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.492573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1104/2223] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:33.497561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.499580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:33.524742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fafbdb-a3a7-4a80-a5d4-595205b2e7f4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:33.715523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce765a2-3432-43dd-9837-a86210ac8169 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:33.730740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:33.731476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.731791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.735830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.736799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.743747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.770513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1120/2224] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:33.774405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.781413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:33.782772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.783412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.788603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.789392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.794706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.795801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3bbe-9aac-401e-bc3f-e8756a65b7b0 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:33.810859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37da9-6bb2-4ac9-8526-71f1d66a1645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:33.812817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37da9-6bb2-4ac9-8526-71f1d66a1645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.813091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37da9-6bb2-4ac9-8526-71f1d66a1645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.813273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37da9-6bb2-4ac9-8526-71f1d66a1645 admin admin] PATH_INFO: `/v3/projects/b1f6ac1aa2ae49558179985f2d28b3f1/users/3a785c5fa5094ab1a50a11c3f563cb3e/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.823468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c37da9-6bb2-4ac9-8526-71f1d66a1645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f6ac1aa2ae49558179985f2d28b3f1, user_id=3a785c5fa5094ab1a50a11c3f563cb3e, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:33.830336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c37da9-6bb2-4ac9-8526-71f1d66a1645 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:33.883645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1121/2225] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:33 2022] PUT /identity/v3/projects/b1f6ac1aa2ae49558179985f2d28b3f1/users/3a785c5fa5094ab1a50a11c3f563cb3e/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:33.887318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:33.888107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:33.888107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:33.889890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1105/2226] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:33 2022] POST /identity/v3/projects => generated 385 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:34:33.897282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:33.980192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] MFA Rules not processed for user `3a785c5fa5094ab1a50a11c3f563cb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:33.982260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:34.117242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968d1e-201d-473e-be8d-3ed5ef01882f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.123577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.124208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.124532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.124986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.126310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.129317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.158371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1106/2227] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:33 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:34.161640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1122/2228] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:34.168240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:34.173393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:34.175576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:34.182318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27019-f7be-4ee5-8e26-422f5146dc32 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.189093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.189297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.189504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.189795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.190577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.194055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.221561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1107/2229] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:34.231293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:34.233738 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:34.246008 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b94bb-81d2-418b-baf7-93bf41556561 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.255859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.257364 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.257871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.258298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] PATH_INFO: `/v3/projects/46e4c05d7d454f8682264c958aa72263/users/66098bc299e4435a956d6b2b0f3a6604/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.267171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:34.289456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597c8e7-7b0b-4fe3-ac96-c856ec6023cd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.290087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e4c05d7d454f8682264c958aa72263, user_id=66098bc299e4435a956d6b2b0f3a6604, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.295377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.297725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.298233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.298732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.299262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.317425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1108/2230] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:34 2022] PUT /identity/v3/projects/46e4c05d7d454f8682264c958aa72263/users/66098bc299e4435a956d6b2b0f3a6604/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:34.321579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.323124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.324486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:34.345505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1123/2231] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:34.436000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:34.450288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c826af-337c-49a7-ac8e-e0ab8d1e56d8 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.465332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc217b-208c-41f4-a0fb-385538adb6bc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.475648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.476648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.477206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.477836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.479157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.482256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.501089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1109/2232] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:34.502168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:34.512461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76160f-59ab-434a-8555-e58c666e18b6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:34.517627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.518538 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.518819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.519102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] PATH_INFO: `/v3/projects/46e4c05d7d454f8682264c958aa72263/users/66098bc299e4435a956d6b2b0f3a6604/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.521847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e4c05d7d454f8682264c958aa72263, user_id=66098bc299e4435a956d6b2b0f3a6604, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.524660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.533874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1c2e-5f0b-4b38-9b6a-4a3bb07506ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:34.534569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1c2e-5f0b-4b38-9b6a-4a3bb07506ed service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:34.534998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1c2e-5f0b-4b38-9b6a-4a3bb07506ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:34.535436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1c2e-5f0b-4b38-9b6a-4a3bb07506ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:34.539381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1110/2233] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:34 2022] PUT /identity/v3/projects/46e4c05d7d454f8682264c958aa72263/users/66098bc299e4435a956d6b2b0f3a6604/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:34.647076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e1c2e-5f0b-4b38-9b6a-4a3bb07506ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:34.649321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e1c2e-5f0b-4b38-9b6a-4a3bb07506ed service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:34.663550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1124/2234] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:37.497773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:37.805085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48c45-22e4-4e7a-85e4-997fca60ff03 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:37.848861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:37.851020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:37.852354 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:37.854878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] PATH_INFO: `/v3/users/0bba68bde2ee4ca0b0631b5e9b6c6d3f` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:37.856903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bba68bde2ee4ca0b0631b5e9b6c6d3f)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:37.862467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:38.011061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:38.088850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bba68bde2ee4ca0b0631b5e9b6c6d3f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:38.092582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bba68bde2ee4ca0b0631b5e9b6c6d3f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:38.135604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bba68bde2ee4ca0b0631b5e9b6c6d3f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:38.167510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bba68bde2ee4ca0b0631b5e9b6c6d3f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:38.194379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bba68bde2ee4ca0b0631b5e9b6c6d3f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:38.207471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1111/2235] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:37 2022] DELETE /identity/v3/users/0bba68bde2ee4ca0b0631b5e9b6c6d3f => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:38.215952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:38.216567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:38.216567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:38.360506 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:38.362106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:38.519802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:38.560840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1125/2236] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:38.582720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:38.584614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:38.834594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304e90-9d2e-431c-941b-3d36f2fd36ae admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:38.844656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd2ace-4e90-433e-a4c1-13eb46e3b4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:38.845459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd2ace-4e90-433e-a4c1-13eb46e3b4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:38.845855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd2ace-4e90-433e-a4c1-13eb46e3b4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:38.846346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd2ace-4e90-433e-a4c1-13eb46e3b4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:38.871681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd2ace-4e90-433e-a4c1-13eb46e3b4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:38.873694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd2ace-4e90-433e-a4c1-13eb46e3b4f6 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:38.922142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1112/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:39.163267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:39.165287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:39.213827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557591ee-ae73-4ed9-ad72-0eba02a92370 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:39.227363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:39.230090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:39.230658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:39.231310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] PATH_INFO: `/v3/users/19387fd70b924ad1a05424c7a0a6e181` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:39.233087 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19387fd70b924ad1a05424c7a0a6e181)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:39.235484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:39.347665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19387fd70b924ad1a05424c7a0a6e181'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:39.349037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19387fd70b924ad1a05424c7a0a6e181'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:39.374298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19387fd70b924ad1a05424c7a0a6e181'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:39.406789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19387fd70b924ad1a05424c7a0a6e181'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:39.407764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19387fd70b924ad1a05424c7a0a6e181'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:39.452491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1126/2238] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:39 2022] DELETE /identity/v3/users/19387fd70b924ad1a05424c7a0a6e181 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:39.458493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:39.461621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:39.462197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:39.510886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:39.514453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:39.727315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1113/2239] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:39.746141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:39.748681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:39.870631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ddf65-a0f7-4baf-80fb-117731480459 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:39.882239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432783c3-6800-488e-b97c-0b2aef1c642a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:39.883558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432783c3-6800-488e-b97c-0b2aef1c642a service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:39.884094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432783c3-6800-488e-b97c-0b2aef1c642a service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:39.884605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432783c3-6800-488e-b97c-0b2aef1c642a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:39.887214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:39.894995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:39.937580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e1e02-79a9-4610-bf10-3697f17701d7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:39.940136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432783c3-6800-488e-b97c-0b2aef1c642a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:39.941680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432783c3-6800-488e-b97c-0b2aef1c642a service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:39.945073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:39.946003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:39.946468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:39.946737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] PATH_INFO: `/v3/projects/5a18927c5b4c46aabaaf9c17b252ed45` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:39.948288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a18927c5b4c46aabaaf9c17b252ed45)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:39.950491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:39.962171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1127/2240] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:39.975929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:40.046513 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a18927c5b4c46aabaaf9c17b252ed45', 'request_id': 'req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:40.054779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a18927c5b4c46aabaaf9c17b252ed45', 'request_id': 'req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:40.067007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a18927c5b4c46aabaaf9c17b252ed45', 'request_id': 'req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:40.104978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] The token cache is being invalidate because project 5a18927c5b4c46aabaaf9c17b252ed45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:40.105691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:40.107196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-b3f319f3-c1bb-47c7-94ca-6cbfa5925c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:40.110804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1114/2241] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:39 2022] DELETE /identity/v3/projects/5a18927c5b4c46aabaaf9c17b252ed45 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:40.117622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:40.119177 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:40.119367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:40.248818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:40.252334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:40.521299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:40.587137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1128/2242] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:40.592393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a8010-38ca-478f-8b09-03df39df867b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:40.593266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a8010-38ca-478f-8b09-03df39df867b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:40.595438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a8010-38ca-478f-8b09-03df39df867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:40.659739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-621a8010-38ca-478f-8b09-03df39df867b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:40.662026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-621a8010-38ca-478f-8b09-03df39df867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:40.689529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1115/2243] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:40.694975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:40.719612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f81e-3acd-42ea-84a2-125e7e789bb4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:40.738334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:40.744881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:40.745611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:40.746234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:40.748010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:40.748742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:40.752699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:40.821119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1129/2244] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:34:40.825635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a8010-38ca-478f-8b09-03df39df867b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:40.861935 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a8010-38ca-478f-8b09-03df39df867b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:40.931919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:40.933216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:40.940127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:40.941130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:40.943197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:40.951023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:41.129631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:41.133757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:41.155216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1116/2245] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:40 2022] POST /identity/v3/projects => generated 385 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:41.169117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:41.196056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d8e8-4238-4c3b-bf52-c5b5027b089f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:41.375075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:41.376509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:41.376813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:41.377101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] PATH_INFO: `/v3/projects/0e0f6bbd39a045edaa8bd7834b5aad03` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:41.379390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0f6bbd39a045edaa8bd7834b5aad03)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:41.381457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:41.400260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390695c-6364-4e3d-921c-95096b153ec1 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:41.419893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:41.420924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:41.421208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:41.421479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:41.422364 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:41.428609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:41.476652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1117/2246] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:41 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:41.479396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:41.500706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0f6bbd39a045edaa8bd7834b5aad03', 'request_id': 'req-4b1b8669-837a-4aa9-a882-28f45fc0acc7'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.505752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035103-3c44-4b9d-b6f5-1ad54eae5cbd admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:41.515394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0f6bbd39a045edaa8bd7834b5aad03', 'request_id': 'req-4b1b8669-837a-4aa9-a882-28f45fc0acc7'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.530801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0f6bbd39a045edaa8bd7834b5aad03', 'request_id': 'req-4b1b8669-837a-4aa9-a882-28f45fc0acc7'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.562333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] The token cache is being invalidate because project 0e0f6bbd39a045edaa8bd7834b5aad03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:41.562846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.564572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.571434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1130/2247] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:41 2022] DELETE /identity/v3/projects/0e0f6bbd39a045edaa8bd7834b5aad03 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:41.572753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:41.583288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:41.658406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:41.675881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:41.676634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:41.681274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:41.681568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:41.682373 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:41.684271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:41.710257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1118/2248] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:41.715865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:41.722491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:41.743069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b8669-837a-4aa9-a882-28f45fc0acc7 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:41.749975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:41.751120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:41.751512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:41.751982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] PATH_INFO: `/v3/users/8649d914ed8f48dcb4e0289895c81d8e` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:41.753759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8649d914ed8f48dcb4e0289895c81d8e)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:41.756808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:41.776678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02145903-86fc-4dec-9e1e-a6a59927362a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:41.786704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:41.800023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:41.801914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:41.802295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:41.802449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] PATH_INFO: `/v3/users/3a785c5fa5094ab1a50a11c3f563cb3e` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:41.813464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a785c5fa5094ab1a50a11c3f563cb3e)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:41.818652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:41.861548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8649d914ed8f48dcb4e0289895c81d8e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.864672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8649d914ed8f48dcb4e0289895c81d8e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.891249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8649d914ed8f48dcb4e0289895c81d8e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.938904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8649d914ed8f48dcb4e0289895c81d8e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.939933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8649d914ed8f48dcb4e0289895c81d8e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:41.957930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1131/2249] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:41 2022] DELETE /identity/v3/users/8649d914ed8f48dcb4e0289895c81d8e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:41.959152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:41.960915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:42.001214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a785c5fa5094ab1a50a11c3f563cb3e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:42.003544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a785c5fa5094ab1a50a11c3f563cb3e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:42.037834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a785c5fa5094ab1a50a11c3f563cb3e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:42.081875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a785c5fa5094ab1a50a11c3f563cb3e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:42.109643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-40b8d141-8979-48c3-94fc-dfaa5656fdbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a785c5fa5094ab1a50a11c3f563cb3e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:42.128999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1119/2250] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:41 2022] DELETE /identity/v3/users/3a785c5fa5094ab1a50a11c3f563cb3e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:42.134821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:42.134821 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:42.137804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:42.196450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678aa89-f3a2-43da-8f1f-8b1b74936398 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:42.221298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:42.224502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:42.454415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1120/2251] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:42.469198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:42.470834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:42.594093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:42.595297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:42.602461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:42.605909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873051-fc9a-47c1-ba72-caae9f268feb None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:42.609463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:42.611029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:42.616433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5decf-300e-4eed-a097-e2415aa7cae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:42.618928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5decf-300e-4eed-a097-e2415aa7cae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:42.619283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5decf-300e-4eed-a097-e2415aa7cae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:42.619561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5decf-300e-4eed-a097-e2415aa7cae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:42.629094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:42.653079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5decf-300e-4eed-a097-e2415aa7cae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:42.658703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5decf-300e-4eed-a097-e2415aa7cae8 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:42.678798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1132/2252] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 717 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:42.680885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:42.687180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:42.708382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1121/2253] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:42.746481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195002d-cff4-44d4-ae96-f008a946d1a8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:42.767438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:42.769308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:42.769905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:42.771039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] PATH_INFO: `/v3/projects/96fe7ce798ec4fdd8355cc611f9a5977/users/1e8394c9aaee498f8a7a07606336fb7e/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:42.838439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fe7ce798ec4fdd8355cc611f9a5977, user_id=1e8394c9aaee498f8a7a07606336fb7e, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:42.844216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:42.900258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1133/2254] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:42 2022] PUT /identity/v3/projects/96fe7ce798ec4fdd8355cc611f9a5977/users/1e8394c9aaee498f8a7a07606336fb7e/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:42.922910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:42.923191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:42.923530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:43.003804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:43.042163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] MFA Rules not processed for user `1e8394c9aaee498f8a7a07606336fb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:43.046403 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:43.342449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1122/2255] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:43.345877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:43.386714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:43.388279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:43.417641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:43.560554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148a9f-880b-4e9a-b3b8-704d82a1805b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:43.578956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:43.579916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:43.580215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:43.580484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] PATH_INFO: `/v3/projects/b1f6ac1aa2ae49558179985f2d28b3f1` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:43.585658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f6ac1aa2ae49558179985f2d28b3f1)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:43.587708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:43.590488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac049d-1769-4110-ae7c-8b1ac3a57290 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:43.600882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:43.619507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:43.620478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:43.621259 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:43.626437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:43.640558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:43.711937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f6ac1aa2ae49558179985f2d28b3f1', 'request_id': 'req-6d9ddffa-763a-46fe-8f82-46cc23016fe0'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:43.725886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f6ac1aa2ae49558179985f2d28b3f1', 'request_id': 'req-6d9ddffa-763a-46fe-8f82-46cc23016fe0'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:43.733891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1134/2256] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:43 2022] POST /identity/v3/projects => generated 383 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:43.736964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f6ac1aa2ae49558179985f2d28b3f1', 'request_id': 'req-6d9ddffa-763a-46fe-8f82-46cc23016fe0'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:43.737310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:43.770940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] The token cache is being invalidate because project b1f6ac1aa2ae49558179985f2d28b3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:43.771229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:43.773499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d9ddffa-763a-46fe-8f82-46cc23016fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:43.784884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1123/2257] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:43 2022] DELETE /identity/v3/projects/b1f6ac1aa2ae49558179985f2d28b3f1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:34:43.795245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005fdf-131b-48a8-a3df-1d4778ca0934 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:43.795445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005fdf-131b-48a8-a3df-1d4778ca0934 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:43.795882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005fdf-131b-48a8-a3df-1d4778ca0934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:43.857625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-50005fdf-131b-48a8-a3df-1d4778ca0934 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:43.858946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-50005fdf-131b-48a8-a3df-1d4778ca0934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:43.906200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:43.913783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823c2c2-5917-4eff-a86b-aefe7c1aeebb admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:43.921448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:43.922604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:43.923142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:43.923686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:43.925260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:43.928989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:43.965520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1135/2258] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:43 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:43.970388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:43.974246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:43.998021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bce0a-9725-42ff-8043-2a8a448614b4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.004611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1124/2259] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:44.006666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.006970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.007258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.025937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.026644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.026932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.027217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.028179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.029899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.052997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1136/2260] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:44.058740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.059140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:44.069510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:44.073002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadba63-7133-4073-a504-ac0a1cfad48c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.078311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.080319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.080682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.081013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.081914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.083654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.091708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1125/2261] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:44.106080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.137917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1137/2262] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:44.143180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.159700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eb68b-3d4a-4e2d-9054-226ec29e7a12 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.164071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e868397-ea5d-45d8-ad66-3f5b6e10f19e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.178700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.181564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.183058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.185426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] PATH_INFO: `/v3/projects/9b4685e9dcfc4e90a23dd63c48fe768a/users/b0d55c9b1b7e4eea92f181a8bc426c85/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.190796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.193399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.197340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.198886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.201628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:44.202521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.206878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.256942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1126/2263] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:44.266700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.282263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4685e9dcfc4e90a23dd63c48fe768a, user_id=b0d55c9b1b7e4eea92f181a8bc426c85, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.299017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.317405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75785f0-80cc-4017-a219-784afc14d52a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.337293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a193ac-909b-4a2c-8ddf-c8356c078151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.338022 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a193ac-909b-4a2c-8ddf-c8356c078151 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.343096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a193ac-909b-4a2c-8ddf-c8356c078151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.343495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a193ac-909b-4a2c-8ddf-c8356c078151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.344372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a193ac-909b-4a2c-8ddf-c8356c078151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.346886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a193ac-909b-4a2c-8ddf-c8356c078151 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.359002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1138/2264] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:44 2022] PUT /identity/v3/projects/9b4685e9dcfc4e90a23dd63c48fe768a/users/b0d55c9b1b7e4eea92f181a8bc426c85/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:44.360607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.372813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:44.425117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1127/2265] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:44 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:44.425117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.425117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.425117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.490499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] MFA Rules not processed for user `b0d55c9b1b7e4eea92f181a8bc426c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:44.492132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:44.495270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:44.546974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cf230-1f84-4011-a786-2a844460648b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.611168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1128/2266] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:44.612440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.752912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.756001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.756661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.757286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] PATH_INFO: `/v3/projects/357a0d37747545239e4b7f608f10ea7b` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.760148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357a0d37747545239e4b7f608f10ea7b)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.765440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.851036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e1b8-ec5e-4582-bfe9-eb493e078d52 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.869003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:44.870303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:44.870825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:44.871315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:44.872773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:44.883536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:44.915432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357a0d37747545239e4b7f608f10ea7b', 'request_id': 'req-5cae63de-e794-41bd-ae39-d6f7bd331ef3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:44.922550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357a0d37747545239e4b7f608f10ea7b', 'request_id': 'req-5cae63de-e794-41bd-ae39-d6f7bd331ef3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:44.931208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1129/2267] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:44 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:44.931473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357a0d37747545239e4b7f608f10ea7b', 'request_id': 'req-5cae63de-e794-41bd-ae39-d6f7bd331ef3'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:44.932712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.960006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb45c4c-9e01-442e-a2d4-2c04ec93679b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:44.965470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] The token cache is being invalidate because project 357a0d37747545239e4b7f608f10ea7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:44.965955 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:44.967038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:44.968652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:44.970991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1139/2268] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:44 2022] DELETE /identity/v3/projects/357a0d37747545239e4b7f608f10ea7b => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:44.973591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:44.976866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:45.070208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.071095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.071701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.072407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.073479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.077046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.088147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae63de-e794-41bd-ae39-d6f7bd331ef3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.094194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9933-ad64-4cbb-94e5-a45a0c82b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.095080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9933-ad64-4cbb-94e5-a45a0c82b156 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.095477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9933-ad64-4cbb-94e5-a45a0c82b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.095974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9933-ad64-4cbb-94e5-a45a0c82b156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.096811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9933-ad64-4cbb-94e5-a45a0c82b156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.098709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9933-ad64-4cbb-94e5-a45a0c82b156 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.121198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1140/2269] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:45.124411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.124719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.125015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.129021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1130/2270] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:44 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:45.131205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.163024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:45.165111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:45.187538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:45.290171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7b05-dafe-4ef0-b3c7-c558f6e4bd0f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.312347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.313451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.314114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.314575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.316231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.322153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.368185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1131/2271] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:45.369136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.373374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:45.390623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1141/2272] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:45.394789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.412690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6a893-b5a7-40aa-88d8-516bcd51a62d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.420377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a85f9-8b56-4158-bd53-f5783e097038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.421080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a85f9-8b56-4158-bd53-f5783e097038 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.421369 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a85f9-8b56-4158-bd53-f5783e097038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.421656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a85f9-8b56-4158-bd53-f5783e097038 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.422372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a85f9-8b56-4158-bd53-f5783e097038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.424406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a85f9-8b56-4158-bd53-f5783e097038 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.444297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfad81-9cde-474f-8fda-f1ca8942fc99 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.460880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.463274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.463973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.464632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] PATH_INFO: `/v3/projects/9a837a25d0654670a2b942ac745a68a3/users/358eeb3f26de4999a3ce06bd8e5bbeda/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.483457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1132/2273] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:45 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:45.484822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.485128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.485386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.509104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a837a25d0654670a2b942ac745a68a3, user_id=358eeb3f26de4999a3ce06bd8e5bbeda, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.515376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:45.515683 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.516789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:45.531396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1133/2274] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:45.532607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.554793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf98e7-f828-4c02-b9d2-c2fcb7d224f9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.555771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1142/2275] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:45 2022] PUT /identity/v3/projects/9a837a25d0654670a2b942ac745a68a3/users/358eeb3f26de4999a3ce06bd8e5bbeda/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:45.557377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.684439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a328-2291-42c1-9ba2-b7c1ac59b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.685197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a328-2291-42c1-9ba2-b7c1ac59b603 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.685489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a328-2291-42c1-9ba2-b7c1ac59b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.685770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a328-2291-42c1-9ba2-b7c1ac59b603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.686528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82a328-2291-42c1-9ba2-b7c1ac59b603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.689445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82a328-2291-42c1-9ba2-b7c1ac59b603 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.703367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:45.717163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1134/2276] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:45.722409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.722715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.723587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.759323 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4179-f84d-4e21-b323-d0bddbb39cf1 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.765156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] MFA Rules not processed for user `358eeb3f26de4999a3ce06bd8e5bbeda`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:45.766396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:45.778293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.779352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.779352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.779846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.780712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:45.781138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.782933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.808798 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1143/2277] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:45.810541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.825014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82379551-0034-47ec-97f4-01c97736b3a3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:45.830511 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:45.831870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:45.832303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:45.833399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] PATH_INFO: `/v3/projects/25f6c8027d1e4e0a9a1d570c5299f61f/users/95d04402cfe14a658d3760a28c73f9a8/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:45.855879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f6c8027d1e4e0a9a1d570c5299f61f, user_id=95d04402cfe14a658d3760a28c73f9a8, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:45.860618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:45.870780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1135/2278] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:45.871938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.885565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1144/2279] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:45 2022] PUT /identity/v3/projects/25f6c8027d1e4e0a9a1d570c5299f61f/users/95d04402cfe14a658d3760a28c73f9a8/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:45.887247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:45.898633 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f61041-8088-404c-a4f6-fc095a0e049f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.019410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.021936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.022665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.023131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.024117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.028193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.097453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1136/2280] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:45 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:46.098321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:46.166463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ee71-3fee-4342-9629-fd8d9b745f0c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.174910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:46.296850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14592b0-b933-43ed-b79e-4f17e0d40c41 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.303807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f04b86-41c9-4292-ae02-93ed82860f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.304828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f04b86-41c9-4292-ae02-93ed82860f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.305246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f04b86-41c9-4292-ae02-93ed82860f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.306055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f04b86-41c9-4292-ae02-93ed82860f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.306840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f04b86-41c9-4292-ae02-93ed82860f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.308710 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f04b86-41c9-4292-ae02-93ed82860f1c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.314103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.315361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.315934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.316507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.318362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.333281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.338914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1137/2281] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:46.340782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.341623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.342128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.389477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1145/2282] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:45 2022] POST /identity/v3/projects => generated 381 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:46.389477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:46.397387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:46.423324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] MFA Rules not processed for user `66098bc299e4435a956d6b2b0f3a6604`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:46.425250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:46.488496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42863-516a-429e-9e0c-0f553b9fc37c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.495178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.495699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.495984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.496262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.496964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.499144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.546778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1146/2283] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:46 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:46.548786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:46.568361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3b2a2-0382-40ba-8c46-d8da6a63ce8b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.574823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.576202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.576899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.577964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] PATH_INFO: `/v3/projects/25f6c8027d1e4e0a9a1d570c5299f61f/users/95d04402cfe14a658d3760a28c73f9a8/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.581431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f6c8027d1e4e0a9a1d570c5299f61f, user_id=95d04402cfe14a658d3760a28c73f9a8, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.589273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.604841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1138/2284] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:46.604841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:46.618654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1147/2285] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:46 2022] PUT /identity/v3/projects/25f6c8027d1e4e0a9a1d570c5299f61f/users/95d04402cfe14a658d3760a28c73f9a8/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:46.619555 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:46.643798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe978-3c8d-4f29-8b82-e8f6e3b0d00b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.733586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.736966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.737468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.737904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.738979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.742204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.750138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e520-a752-4ecd-a87e-a6226ec32549 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.759255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793396-2df5-4864-989e-07d0cb19b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.760471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793396-2df5-4864-989e-07d0cb19b502 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.761499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793396-2df5-4864-989e-07d0cb19b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.761499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793396-2df5-4864-989e-07d0cb19b502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.762670 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793396-2df5-4864-989e-07d0cb19b502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:46.766024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793396-2df5-4864-989e-07d0cb19b502 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:46.778031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1139/2286] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:46 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:46.779109 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:46.781733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:46.788757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1148/2287] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:46.794592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.795039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.795461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.806648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:46.845647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] MFA Rules not processed for user `95d04402cfe14a658d3760a28c73f9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:46.846913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:46.896015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745bcc-1679-4726-a467-a2f248ffaa23 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:46.911380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:46.924742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:46.925446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:46.926103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:46.930450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:46.976698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1149/2288] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:46.978286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.012284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfcad8-0f92-47e6-9325-11da9860229f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.020100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.021010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.022042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.022546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.024183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.026658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.046962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1150/2289] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:47.048126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.048705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:47.067857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5ae7c-360f-4c35-a941-df49b3baa560 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.077787 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.078824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.079220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.080672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.081659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.083495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.091207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.091207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.099495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1151/2290] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:47.100590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.104028 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.121027 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1140/2291] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:47.121885 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.154615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926767f-c1bb-4a6b-90fe-d59302a02f08 service glance] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.175507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.177190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.177487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.177775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] PATH_INFO: `/v3/projects/254345fccab94229a0f25b109593b4db/users/88db3c77dec24b4abcfb87850fb9aa51/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.217172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=254345fccab94229a0f25b109593b4db, user_id=88db3c77dec24b4abcfb87850fb9aa51, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.220283 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.249432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebbb4e-a071-4955-a4f0-7c114c1e6712 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.256398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1141/2292] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:47 2022] PUT /identity/v3/projects/254345fccab94229a0f25b109593b4db/users/88db3c77dec24b4abcfb87850fb9aa51/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:47.257470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.347398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.351459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.352064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.352898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.355309 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.420792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:47.425611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a728-7f1f-418f-a1f9-75617fbb47ce admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.433600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.434764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.435125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.435575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] PATH_INFO: `/v3/projects/3fda64c0251e424ca9791379c4607b76/users/a934ed32cc17489aa0616b6c6aadfa8b/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.455711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fda64c0251e424ca9791379c4607b76, user_id=a934ed32cc17489aa0616b6c6aadfa8b, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.460004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.463863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.465957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0da5-e72c-43ff-8314-e76363583eec service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.479496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1142/2294] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:47 2022] PUT /identity/v3/projects/3fda64c0251e424ca9791379c4607b76/users/a934ed32cc17489aa0616b6c6aadfa8b/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:47.479676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1152/2294] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:47.480615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.481195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.481495 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.481921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.521342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:47.523394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.569351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e0799-0b79-4696-a9c9-510126fc9b94 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.576552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481769ac-124c-40e8-a9a1-a10f25f7d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.577625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481769ac-124c-40e8-a9a1-a10f25f7d34c admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.577985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481769ac-124c-40e8-a9a1-a10f25f7d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.578167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481769ac-124c-40e8-a9a1-a10f25f7d34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.578908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481769ac-124c-40e8-a9a1-a10f25f7d34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.580784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481769ac-124c-40e8-a9a1-a10f25f7d34c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.599866 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1143/2295] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:47.599866 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.600294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.600656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.625701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:47.627339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.636942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1144/2296] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:47.638233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.649287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1153/2297] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:47.650535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.652376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.652641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24a194-0490-4418-82b9-27d9e828b8ef None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.660954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9a097-be11-4567-8c3b-eb211e11698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.662175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9a097-be11-4567-8c3b-eb211e11698c admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.662471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9a097-be11-4567-8c3b-eb211e11698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.662756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9a097-be11-4567-8c3b-eb211e11698c admin admin] PATH_INFO: `/v3/projects/254345fccab94229a0f25b109593b4db/users/88db3c77dec24b4abcfb87850fb9aa51/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.665355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9a097-be11-4567-8c3b-eb211e11698c admin admin] RBAC: Authorizing `identity:create_grant(project_id=254345fccab94229a0f25b109593b4db, user_id=88db3c77dec24b4abcfb87850fb9aa51, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.668308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9a097-be11-4567-8c3b-eb211e11698c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:47.692311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1145/2298] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:47 2022] PUT /identity/v3/projects/254345fccab94229a0f25b109593b4db/users/88db3c77dec24b4abcfb87850fb9aa51/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:47.694213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.694641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.694911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.730004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] MFA Rules not processed for user `88db3c77dec24b4abcfb87850fb9aa51`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:47.731663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.737380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:47.796962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3bab6-4868-4bf0-bf97-a08f0d42fefd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:47.872177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1146/2299] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:47.876716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:47.878313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:47.878874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:47.880593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:47.880948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:47.881680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:47.969685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:47.993061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:47.994947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:48.016258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1154/2300] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:48.017485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:48.019437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:48.035205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a14616-3cce-41c3-9bc9-cbe7f3a8ed88 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:48.041934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58de1ba-5c1a-44f7-866e-25f4895820a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:48.042792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de1ba-5c1a-44f7-866e-25f4895820a8 service swift] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:48.043271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de1ba-5c1a-44f7-866e-25f4895820a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:48.043800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de1ba-5c1a-44f7-866e-25f4895820a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:48.097711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23711c27-be70-48bb-b473-02650728b28d service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:48.102202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:48.102822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:48.103116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:48.103507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:48.143667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:48.163880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:48.227415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1155/2301] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:48.253281 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58de1ba-5c1a-44f7-866e-25f4895820a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:48.262530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58de1ba-5c1a-44f7-866e-25f4895820a8 service swift] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:48.289517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1147/2302] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:34:48.442743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:48.487419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b989dc-941c-4e6d-9689-05d0d4f4b053 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:48.493726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:48.494397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:48.494678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:48.496868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:48.754344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:48.757464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:48.800030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1156/2303] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:49.845393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:49.846032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:49.846032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:49.956144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] MFA Rules not processed for user `a934ed32cc17489aa0616b6c6aadfa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:49.958437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:49.965021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:49.975033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527d1d3-0044-4b09-948e-51f056b946a2 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:49.990956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:49.991995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:49.994525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:49.994917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:49.998374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:50.061683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:50.180202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1148/2304] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:50.196664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:50.212569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602e7a-ef6b-49aa-b84e-5f67c8dc03f2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:50.216827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:50.217579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:50.218386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:50.218744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:50.236507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:50.237741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:50.252072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:50.255926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1be97-aaca-437e-9725-c9006737bce9 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:50.259054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1149/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:50.295124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1157/2306] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:51.579282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:51.596800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5f57b-3da4-4f42-ade3-1666fc05eb7d service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:51.627103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:51.628448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:51.629242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:51.630012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:51.798327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:51.800102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:51.828037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1150/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:52.410304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a13e-af49-431c-ad5f-0381b5481081 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:52.411605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a13e-af49-431c-ad5f-0381b5481081 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:52.412104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a13e-af49-431c-ad5f-0381b5481081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:52.453926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-06f3a13e-af49-431c-ad5f-0381b5481081 None None] MFA Rules not processed for user `a934ed32cc17489aa0616b6c6aadfa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:52.456246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-06f3a13e-af49-431c-ad5f-0381b5481081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:52.499437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1158/2308] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:52.771728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:52.810600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9139ff-15d8-45c5-b695-0e2b527e62f7 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:52.835108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:52.838177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:52.840197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:52.840955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] PATH_INFO: `/v3/users/358eeb3f26de4999a3ce06bd8e5bbeda` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:52.843208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] RBAC: Authorizing `identity:delete_user(user_id=358eeb3f26de4999a3ce06bd8e5bbeda)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:52.848346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:53.028167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358eeb3f26de4999a3ce06bd8e5bbeda'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:53.029449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358eeb3f26de4999a3ce06bd8e5bbeda'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:53.060067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358eeb3f26de4999a3ce06bd8e5bbeda'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:53.104329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358eeb3f26de4999a3ce06bd8e5bbeda'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:53.134077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358eeb3f26de4999a3ce06bd8e5bbeda'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:53.157092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1151/2309] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:52 2022] DELETE /identity/v3/users/358eeb3f26de4999a3ce06bd8e5bbeda => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:53.161623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:53.162366 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:53.162932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:53.293728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:53.304206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:53.417017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:53.598886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1159/2310] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:53.665594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:53.669065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:53.849410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:53.940119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0c6ec-c564-400e-98d1-bfa0ffda416d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:53.945113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:53.945967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:53.950213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:53.950660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:53.975705 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:53.980772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:54.004555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1152/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:34:54.581839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:54.584710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:54.609509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c659-7935-4e83-b1f5-c29fef233e21 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:54.635864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:54.635864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:54.635864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:54.635864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] PATH_INFO: `/v3/projects/9a837a25d0654670a2b942ac745a68a3` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:54.641639 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a837a25d0654670a2b942ac745a68a3)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:54.646594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:54.872908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a837a25d0654670a2b942ac745a68a3', 'request_id': 'req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:54.885393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a837a25d0654670a2b942ac745a68a3', 'request_id': 'req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:54.901672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a837a25d0654670a2b942ac745a68a3', 'request_id': 'req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:54.930187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] The token cache is being invalidate because project 9a837a25d0654670a2b942ac745a68a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:54.930601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:54.931549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9f6bfa6b-0b0e-49e1-a1a4-44302b755a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:54.933657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1160/2312] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:54 2022] DELETE /identity/v3/projects/9a837a25d0654670a2b942ac745a68a3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:54.938400 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:54.953855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a000c-246a-471f-a53e-0655887104e5 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:55.059281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3158-d6e7-4639-83db-a4b3b8ecd4fa None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:55.059793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3158-d6e7-4639-83db-a4b3b8ecd4fa None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:55.060219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3158-d6e7-4639-83db-a4b3b8ecd4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:55.071393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:55.073155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:55.077020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:55.077367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] PATH_INFO: `/v3/users/88db3c77dec24b4abcfb87850fb9aa51` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:55.079758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88db3c77dec24b4abcfb87850fb9aa51)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:55.084597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:55.102195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-eaea3158-d6e7-4639-83db-a4b3b8ecd4fa None None] MFA Rules not processed for user `a9c3307d1ae5495ea2d0790eb39e3b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:55.106795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-eaea3158-d6e7-4639-83db-a4b3b8ecd4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:55.236684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88db3c77dec24b4abcfb87850fb9aa51'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:55.240343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88db3c77dec24b4abcfb87850fb9aa51'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:55.264469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88db3c77dec24b4abcfb87850fb9aa51'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:55.308120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88db3c77dec24b4abcfb87850fb9aa51'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:55.320619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88db3c77dec24b4abcfb87850fb9aa51'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:55.323800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1161/2313] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:34:55.373492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1153/2314] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:54 2022] DELETE /identity/v3/users/88db3c77dec24b4abcfb87850fb9aa51 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:56.447661 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:56.449493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:56.450225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:56.517760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] MFA Rules not processed for user `4df5c2b1e22f4c54b05eb77d9ba9818b`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:56.519285 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:56.628711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:56.649618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1162/2315] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:56.736140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:56.737641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:56.882452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:56.885169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:56.888958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:56.932431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd25042-7fd1-456e-8857-4a0848bfca72 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:56.950271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:56.951568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:56.951887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:56.952165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] PATH_INFO: `/v3/projects/254345fccab94229a0f25b109593b4db` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:56.953946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254345fccab94229a0f25b109593b4db)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:56.958275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:57.023175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254345fccab94229a0f25b109593b4db', 'request_id': 'req-a680d101-d8c8-4678-8f87-e67bb49f96d2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.032269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254345fccab94229a0f25b109593b4db', 'request_id': 'req-a680d101-d8c8-4678-8f87-e67bb49f96d2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.040477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254345fccab94229a0f25b109593b4db', 'request_id': 'req-a680d101-d8c8-4678-8f87-e67bb49f96d2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.063510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] The token cache is being invalidate because project 254345fccab94229a0f25b109593b4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:57.063803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.066494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-a680d101-d8c8-4678-8f87-e67bb49f96d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.070658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1154/2316] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:56 2022] DELETE /identity/v3/projects/254345fccab94229a0f25b109593b4db => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:57.075587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf770-7dba-4e3d-a782-faad4aa56c4a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:57.075905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf770-7dba-4e3d-a782-faad4aa56c4a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:57.078863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf770-7dba-4e3d-a782-faad4aa56c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:57.141322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b0f9-167c-494e-af84-7448aee408c2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:57.163844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1eabf770-7dba-4e3d-a782-faad4aa56c4a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:57.167424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1eabf770-7dba-4e3d-a782-faad4aa56c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:57.276278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1155/2317] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:57.286423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:57.287130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:57.287783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:57.331524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:57.333051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:57.333333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:57.333615 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] PATH_INFO: `/v3/users/1e8394c9aaee498f8a7a07606336fb7e` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:57.335910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8394c9aaee498f8a7a07606336fb7e)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:57.338084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:57.355442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:57.364667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:57.423690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1156/2318] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:57.428058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:57.456528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8394c9aaee498f8a7a07606336fb7e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.457924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8394c9aaee498f8a7a07606336fb7e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.474398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8394c9aaee498f8a7a07606336fb7e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.481477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cd376-20c9-4d22-a014-ae8a72d39bd9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:57.502878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:57.505948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:57.506242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:57.506525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:57.507343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:34:57.507678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:57.515639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:57.526716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8394c9aaee498f8a7a07606336fb7e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.530783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-337396aa-4c65-4618-b66c-82cc1f50295c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8394c9aaee498f8a7a07606336fb7e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:57.590447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1157/2319] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:34:57.605043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:57.608799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1163/2320] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:56 2022] DELETE /identity/v3/users/1e8394c9aaee498f8a7a07606336fb7e => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:57.612535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:57.616559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:57.617095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:57.622261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:57.675268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05131-133b-409e-9a2a-9bafabff8ed4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:57.688143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:57.690313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:57.760735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:57.886516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:57.964279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1164/2321] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:57.973356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:57.974368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:57.975672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:57.976234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:57.977252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:57.979587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:58.011697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:58.013633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:58.029102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1158/2322] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:57 2022] POST /identity/v3/projects => generated 409 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:58.030524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:58.121346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f760-ed1a-40f7-ac8f-a5fa09b7000b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:58.141665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:58.142521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.142907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.144488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.145650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:58.148001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:58.181987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1159/2323] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:58 2022] POST /identity/v3/users => generated 305 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:58.183546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:58.193127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3c7d6-e508-476f-8fc8-c8dd18799bed None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:58.201449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a915ed0-5b8c-4af9-8465-c8099db4b92f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:58.210957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:58.211949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.212534 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.212931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.214237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:58.216938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:58.235876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1160/2324] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:58.241522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:58.269076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6008a-fe56-45bc-a6e7-3185268020e2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:58.305240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:58.306969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.307271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.307549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.313750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33f00-2e24-42c3-8f07-10a650c4f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:58.314881 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33f00-2e24-42c3-8f07-10a650c4f4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.315348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33f00-2e24-42c3-8f07-10a650c4f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.315862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33f00-2e24-42c3-8f07-10a650c4f4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.317748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33f00-2e24-42c3-8f07-10a650c4f4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:58.320653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33f00-2e24-42c3-8f07-10a650c4f4b7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:58.334935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:58.336425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:58.350916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1165/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:34:58.363754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1161/2326] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:58.369457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:58.403272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda2107-bd68-41d6-b735-e9411031c436 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:58.412316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:58.413389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.413730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.414012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] PATH_INFO: `/v3/projects/a49be59a836d48f7980514ba126d3cd4/users/c6600d8077324455bdb2478f1557c5cc/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.451474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49be59a836d48f7980514ba126d3cd4, user_id=c6600d8077324455bdb2478f1557c5cc, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:58.457741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:58.484166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1166/2327] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:58 2022] PUT /identity/v3/projects/a49be59a836d48f7980514ba126d3cd4/users/c6600d8077324455bdb2478f1557c5cc/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:58.498187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.501181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.502239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.575120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] MFA Rules not processed for user `c6600d8077324455bdb2478f1557c5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:34:58.577570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:58.701350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1162/2328] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:34:58.708109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:58.904731 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:58.910673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536215a2-3b64-4647-a40d-7012bd8aa4c3 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:58.943508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:58.944496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:58.946519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:58.947014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:58.950649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:58.952973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.059422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.060268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1167/2329] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:34:58 2022] POST /identity/v3/projects => generated 409 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:59.074267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17509d3-173a-43c0-9088-239e9a4b218c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.124480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:59.170675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.171478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.171917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.172401 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.173616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.176319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.217097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1163/2330] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:34:59 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:34:59.221967 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.237012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab540-5658-4915-9319-21ba97e850b2 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.244728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.246275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.246642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.247131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.248460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.250621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.304916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.306973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:59.351880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402c90-c105-443d-b667-a6f4585d14ca admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.353654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1168/2331] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:34:59.360138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.395653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.402267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.407005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.410318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] PATH_INFO: `/v3/projects/96fe7ce798ec4fdd8355cc611f9a5977` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.416891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fe7ce798ec4fdd8355cc611f9a5977)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.423320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.432113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd44f-9d6b-4fd5-80ed-836790eb14ab admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.465890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.470980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.471302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.471863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] PATH_INFO: `/v3/projects/431b80dd7b7c4214802d2096c55fc2ab/users/733cbf1db8aa4920870f4c6950105326/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.524876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=431b80dd7b7c4214802d2096c55fc2ab, user_id=733cbf1db8aa4920870f4c6950105326, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.529143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.557094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1169/2332] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:59 2022] PUT /identity/v3/projects/431b80dd7b7c4214802d2096c55fc2ab/users/733cbf1db8aa4920870f4c6950105326/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:59.562876 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.571158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fe7ce798ec4fdd8355cc611f9a5977', 'request_id': 'req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:59.582163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fe7ce798ec4fdd8355cc611f9a5977', 'request_id': 'req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:59.592887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fe7ce798ec4fdd8355cc611f9a5977', 'request_id': 'req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:59.640332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] The token cache is being invalidate because project 96fe7ce798ec4fdd8355cc611f9a5977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:34:59.640749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:59.641967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:34:59.647207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1164/2333] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:34:59 2022] DELETE /identity/v3/projects/96fe7ce798ec4fdd8355cc611f9a5977 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:59.650973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.653780 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:59.768690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99837be2-898b-4a53-9065-e2169d4e7edb admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.779145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.780176 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.782770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.783855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.785727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.787952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.825945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1170/2334] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:34:59.827115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:34:59.828960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:34:59.840888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90bab2-7d84-4755-86e9-8bc8c0c73de8 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.853707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464c43-2051-4229-97f6-0e4b5cc021c4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:34:59.860441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7df24-d49b-4b1c-85c0-693554a806ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.861362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7df24-d49b-4b1c-85c0-693554a806ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.861650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7df24-d49b-4b1c-85c0-693554a806ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.861946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7df24-d49b-4b1c-85c0-693554a806ac admin admin] PATH_INFO: `/v3/projects/431b80dd7b7c4214802d2096c55fc2ab/users/733cbf1db8aa4920870f4c6950105326/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.863770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:34:59.865239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.865567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7df24-d49b-4b1c-85c0-693554a806ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=431b80dd7b7c4214802d2096c55fc2ab, user_id=733cbf1db8aa4920870f4c6950105326, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.865734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.866250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] PATH_INFO: `/v3/users/b0d55c9b1b7e4eea92f181a8bc426c85` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:34:59.868735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7df24-d49b-4b1c-85c0-693554a806ac admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.869699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d55c9b1b7e4eea92f181a8bc426c85)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:34:59.883040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:34:59.952417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1171/2335] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:34:59 2022] PUT /identity/v3/projects/431b80dd7b7c4214802d2096c55fc2ab/users/733cbf1db8aa4920870f4c6950105326/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:34:59.962665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:34:59.962942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:34:59.963222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:00.032773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] MFA Rules not processed for user `733cbf1db8aa4920870f4c6950105326`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:00.034741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:00.132827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:00.135858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d55c9b1b7e4eea92f181a8bc426c85'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:00.144826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d55c9b1b7e4eea92f181a8bc426c85'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:00.159579 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d55c9b1b7e4eea92f181a8bc426c85'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:00.172733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1172/2336] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:00.188392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:00.190632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:00.199041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d55c9b1b7e4eea92f181a8bc426c85'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:00.215467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d55c9b1b7e4eea92f181a8bc426c85'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:00.231306 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1165/2337] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:34:59 2022] DELETE /identity/v3/users/b0d55c9b1b7e4eea92f181a8bc426c85 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:00.259029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:00.354986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4668-1e3e-41fe-a68f-b9984d7ea385 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:00.461455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:00.462986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:00.465531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:00.465970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:00.474788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:00.718157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:00.725628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:00.800171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1173/2338] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:01.417236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:01.452162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:01.538288 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744086-e872-46ee-a231-ae35a951c276 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:01.570566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:01.570934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:01.571703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:01.572049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:01.585649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:01.739200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:01.741562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:01.878181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31ed7-7d1b-403c-a3e2-742ea00b43a4 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:01.885673 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:01.889114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:01.890220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:01.890652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:01.890943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] PATH_INFO: `/v3/projects/9b4685e9dcfc4e90a23dd63c48fe768a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:01.892559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4685e9dcfc4e90a23dd63c48fe768a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:01.895150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:01.903092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:01.939563 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:01.955802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1166/2339] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:02.037889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4685e9dcfc4e90a23dd63c48fe768a', 'request_id': 'req-9ff76610-db7a-4d33-bb28-f650e478ad12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.051389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4685e9dcfc4e90a23dd63c48fe768a', 'request_id': 'req-9ff76610-db7a-4d33-bb28-f650e478ad12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.069664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4685e9dcfc4e90a23dd63c48fe768a', 'request_id': 'req-9ff76610-db7a-4d33-bb28-f650e478ad12'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.112406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] The token cache is being invalidate because project 9b4685e9dcfc4e90a23dd63c48fe768a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:02.113729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.114418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.124970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:02.130698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1174/2340] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:01 2022] DELETE /identity/v3/projects/9b4685e9dcfc4e90a23dd63c48fe768a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:02.161469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ede452-cfd8-4982-bcd0-985f3fa073c1 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:02.373204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:02.376693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:02.376693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:02.376693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] PATH_INFO: `/v3/users/95d04402cfe14a658d3760a28c73f9a8` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:02.381674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d04402cfe14a658d3760a28c73f9a8)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:02.385431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:02.591182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d04402cfe14a658d3760a28c73f9a8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.592884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d04402cfe14a658d3760a28c73f9a8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.623270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d04402cfe14a658d3760a28c73f9a8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.635556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:02.645952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d04402cfe14a658d3760a28c73f9a8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.680783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-38ec1f5c-e7e7-487f-8128-ae879c1f073a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d04402cfe14a658d3760a28c73f9a8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:02.700897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1167/2341] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:02 2022] DELETE /identity/v3/users/95d04402cfe14a658d3760a28c73f9a8 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:04.254355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:04.258287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:04.325194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff76610-db7a-4d33-bb28-f650e478ad12 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:04.577844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:04.578960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:04.579402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:04.579933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] PATH_INFO: `/v3/projects/25f6c8027d1e4e0a9a1d570c5299f61f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:04.582831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f6c8027d1e4e0a9a1d570c5299f61f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:04.585281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:04.763978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f6c8027d1e4e0a9a1d570c5299f61f', 'request_id': 'req-5a98eddf-ae70-4785-b23f-fa59c478c23e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:04.775795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f6c8027d1e4e0a9a1d570c5299f61f', 'request_id': 'req-5a98eddf-ae70-4785-b23f-fa59c478c23e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:04.794886 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f6c8027d1e4e0a9a1d570c5299f61f', 'request_id': 'req-5a98eddf-ae70-4785-b23f-fa59c478c23e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:04.818628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] The token cache is being invalidate because project 25f6c8027d1e4e0a9a1d570c5299f61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:04.819302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:04.821426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5a98eddf-ae70-4785-b23f-fa59c478c23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:04.824688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1175/2342] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:04 2022] DELETE /identity/v3/projects/25f6c8027d1e4e0a9a1d570c5299f61f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:04.830569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:04.831097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:04.831457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:04.856699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:04.858085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:04.979904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1168/2343] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:04.980637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:04.980931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:04.981219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.002266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:05.004516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:05.020612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.021345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1176/2344] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:05.035499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7a9ff-e17b-4af4-92f0-db86415a5138 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:05.043031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:05.044274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.044775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.045064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.045822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:35:05.046142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:05.047862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:05.066926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1169/2345] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:35:05.068913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.088347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ae9d-bf25-4ba0-aa0e-750c875897de None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:05.093872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:05.094878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.095312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.095780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.097068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:05.100455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:05.160069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1177/2346] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:05 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:05.161545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.179845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdb51-e2ce-4c74-b18d-2381e8582b80 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:05.367171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:05.368971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.371899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.371899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.371899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:05.374390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:05.419242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1170/2347] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:05 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:35:05.420614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.436216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6199-5169-4dc6-9625-1f5cbf336598 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:05.463337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:05.464085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.464460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.464751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.465546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:05.467255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:05.482820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1178/2348] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:05.484178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.497998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd25aa-d205-45e3-a341-e373c7b4dff2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:05.505184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b4c60-265c-4f83-92ec-4f90e4e4197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:05.506039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4c60-265c-4f83-92ec-4f90e4e4197d admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.508099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4c60-265c-4f83-92ec-4f90e4e4197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.508695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4c60-265c-4f83-92ec-4f90e4e4197d admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.510269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b4c60-265c-4f83-92ec-4f90e4e4197d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:05.513725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b4c60-265c-4f83-92ec-4f90e4e4197d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:05.539447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1171/2349] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:05.540719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.546384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:05.557633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3f4ff-f24a-41e1-ac8d-2865c1b05b6c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:05.572795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:05.572795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.573110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.573408 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] PATH_INFO: `/v3/projects/9b045aa8bca145de9ab17a7810d15ee1/users/e309fc5b2c7d4908a5bd8c461c60c511/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.602018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b045aa8bca145de9ab17a7810d15ee1, user_id=e309fc5b2c7d4908a5bd8c461c60c511, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:05.608400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:05.627669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1179/2350] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:05 2022] PUT /identity/v3/projects/9b045aa8bca145de9ab17a7810d15ee1/users/e309fc5b2c7d4908a5bd8c461c60c511/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:05.639469 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832886-f8a2-4bbf-992e-97b641e6a5ee None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:05.640150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832886-f8a2-4bbf-992e-97b641e6a5ee None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:05.641569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832886-f8a2-4bbf-992e-97b641e6a5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:05.697929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c0832886-f8a2-4bbf-992e-97b641e6a5ee None None] MFA Rules not processed for user `e309fc5b2c7d4908a5bd8c461c60c511`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:05.700853 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c0832886-f8a2-4bbf-992e-97b641e6a5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:05.776415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:05.834806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1172/2351] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:05.868554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:05.871568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:06.064893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249f6ef-dc8a-4caa-9007-2063686684de admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:06.073601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:06.078592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:06.078929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:06.079224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:06.107934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:06.109437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:06.128267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1180/2352] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:07.951143 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0df4-8c4f-4af5-816a-1188b3241179 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:07.951723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0df4-8c4f-4af5-816a-1188b3241179 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:07.951966 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0df4-8c4f-4af5-816a-1188b3241179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:07.982856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-043b0df4-8c4f-4af5-816a-1188b3241179 None None] MFA Rules not processed for user `e309fc5b2c7d4908a5bd8c461c60c511`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:07.984604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-043b0df4-8c4f-4af5-816a-1188b3241179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:07.996079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1173/2353] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:09.518373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:09.521632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:09.702920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3566c1-cff0-4cb5-8a57-001f97bf2d39 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:09.715689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:09.716717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:09.716999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:09.717431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] PATH_INFO: `/v3/users/c6600d8077324455bdb2478f1557c5cc` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:09.719363 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6600d8077324455bdb2478f1557c5cc)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:09.722837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:09.800141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6600d8077324455bdb2478f1557c5cc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:09.800761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6600d8077324455bdb2478f1557c5cc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:09.812743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6600d8077324455bdb2478f1557c5cc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:09.829531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6600d8077324455bdb2478f1557c5cc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:09.832041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-7df7c402-ae48-48f3-8645-d8362355b415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6600d8077324455bdb2478f1557c5cc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:09.844234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:09.854195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1181/2354] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:09 2022] DELETE /identity/v3/users/c6600d8077324455bdb2478f1557c5cc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:09.860438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:09.861015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:09.861429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:09.901095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:09.904492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:10.029329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:10.030137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:10.030802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:10.065005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1174/2355] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:10.084559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] MFA Rules not processed for user `10919eea11f3411ead1facfe3e37bf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:10.086865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:10.092378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:10.099508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:10.279170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653609-e52a-43d0-b5c6-51332a08c8c2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:10.288117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:10.290141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:10.290421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:10.290742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:10.293298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1182/2356] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:10.327345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:10.331120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:10.353585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1175/2357] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:10.888568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:10.891448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:10.932217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e276-b198-42b7-aea4-40491827bec6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:10.941674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:10.943473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:10.944388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:10.944887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] PATH_INFO: `/v3/projects/a49be59a836d48f7980514ba126d3cd4` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:10.947494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49be59a836d48f7980514ba126d3cd4)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:10.951546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:11.067488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49be59a836d48f7980514ba126d3cd4', 'request_id': 'req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.076445 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49be59a836d48f7980514ba126d3cd4', 'request_id': 'req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.102512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49be59a836d48f7980514ba126d3cd4', 'request_id': 'req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.143969 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] The token cache is being invalidate because project a49be59a836d48f7980514ba126d3cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:11.144872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.146029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.157726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1183/2358] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:10 2022] DELETE /identity/v3/projects/a49be59a836d48f7980514ba126d3cd4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:11.159785 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:11.188433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575b18-ebae-4c53-94be-114caea62899 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:11.350465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:11.353205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:11.353948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:11.354858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] PATH_INFO: `/v3/users/733cbf1db8aa4920870f4c6950105326` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:11.357404 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] RBAC: Authorizing `identity:delete_user(user_id=733cbf1db8aa4920870f4c6950105326)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:11.362025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:11.393507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:11.527665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733cbf1db8aa4920870f4c6950105326'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.530638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733cbf1db8aa4920870f4c6950105326'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.564795 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733cbf1db8aa4920870f4c6950105326'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.609968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733cbf1db8aa4920870f4c6950105326'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.626832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1b664654-d8d6-461e-8a43-3d608360aeed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733cbf1db8aa4920870f4c6950105326'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:11.638577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1176/2359] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:11 2022] DELETE /identity/v3/users/733cbf1db8aa4920870f4c6950105326 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:12.158140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.161466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:12.182998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ca5e-88ac-4ca5-8dd5-f4f9b98438cd admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.273048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.274071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.274388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.274726 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] PATH_INFO: `/v3/projects/431b80dd7b7c4214802d2096c55fc2ab` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.276051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431b80dd7b7c4214802d2096c55fc2ab)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.278007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.326906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:12.344082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431b80dd7b7c4214802d2096c55fc2ab', 'request_id': 'req-269d6cde-e0d9-4592-a919-072c2db8bc20'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:12.350827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431b80dd7b7c4214802d2096c55fc2ab', 'request_id': 'req-269d6cde-e0d9-4592-a919-072c2db8bc20'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:12.357719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431b80dd7b7c4214802d2096c55fc2ab', 'request_id': 'req-269d6cde-e0d9-4592-a919-072c2db8bc20'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:12.374982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] The token cache is being invalidate because project 431b80dd7b7c4214802d2096c55fc2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:12.375274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:12.375943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-269d6cde-e0d9-4592-a919-072c2db8bc20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:12.377537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1184/2360] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:12 2022] DELETE /identity/v3/projects/431b80dd7b7c4214802d2096c55fc2ab => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:12.383934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.384581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.384749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.407056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:12.408682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:12.472518 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1177/2361] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:12.480966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.481260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.481575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.508195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:12.510194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:12.526120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1185/2362] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:12.528170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.540512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b282f3-2f76-4928-82f1-52f72634a0de None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.545648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.546479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.546786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.547070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.547920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:35:12.548235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.549897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.563910 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1178/2363] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:35:12.568585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.578859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83fad-d6b3-441f-97b9-7f17d17451b4 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.584398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.585072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.585462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.586008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.586724 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.588908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.618676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1186/2364] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:12 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:35:12.623204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.634762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95509c-5261-4cba-ba47-e743e572c306 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.721683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.723363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.723924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.724424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.725735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.729713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.759452 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1179/2365] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:12 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:12.764896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.784355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85109f-1f2b-4dc6-bbc6-afe47e73063d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.793121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.794234 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.795070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.795217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.796527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.799552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.820328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1187/2366] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:12.825303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.836650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7028-9d83-4127-836f-d0d90cbb8499 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.841600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea676c2c-8303-4b22-ae85-66aa165efb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.842309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea676c2c-8303-4b22-ae85-66aa165efb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.842594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea676c2c-8303-4b22-ae85-66aa165efb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.842875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea676c2c-8303-4b22-ae85-66aa165efb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.843659 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea676c2c-8303-4b22-ae85-66aa165efb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.845362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea676c2c-8303-4b22-ae85-66aa165efb27 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.848655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:12.864539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1180/2367] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:12.869553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:12.883326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432473-922a-477c-a21e-1e5d954f9a06 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:12.890937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:12.892551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.893046 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.893567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] PATH_INFO: `/v3/projects/daeb43587c294cc2b1679d75e9c07236/users/00f4533041554cd9be9eaccd53d8fbc3/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:12.917149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeb43587c294cc2b1679d75e9c07236, user_id=00f4533041554cd9be9eaccd53d8fbc3, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:12.919878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:12.938075 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1188/2368] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:12 2022] PUT /identity/v3/projects/daeb43587c294cc2b1679d75e9c07236/users/00f4533041554cd9be9eaccd53d8fbc3/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:35:12.957593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7030d-b01c-4d9c-a2e9-2bef0121011a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:12.959119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7030d-b01c-4d9c-a2e9-2bef0121011a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:12.959425 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7030d-b01c-4d9c-a2e9-2bef0121011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:13.005028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-97d7030d-b01c-4d9c-a2e9-2bef0121011a None None] MFA Rules not processed for user `00f4533041554cd9be9eaccd53d8fbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:13.007657 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-97d7030d-b01c-4d9c-a2e9-2bef0121011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:13.152514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1181/2369] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:13.164224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:13.167636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:13.343659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521e56-79b3-4cec-a3ac-24ff0dedb90d admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:13.345191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:13.346223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:13.346618 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:13.347174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:13.364337 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:13.365745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:13.390494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1189/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:35:15.681621 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:15.682732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:15.683195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:15.727747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:15.729843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:15.839778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1182/2371] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:15.857017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:15.863242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:15.980811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:16.104233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647335c6-4c1f-4402-9c17-e71fe16af6ab service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:16.127749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5820c-390a-478f-b97d-fcb7878dcf79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:16.128931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5820c-390a-478f-b97d-fcb7878dcf79 service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:16.129569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5820c-390a-478f-b97d-fcb7878dcf79 service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:16.130392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5820c-390a-478f-b97d-fcb7878dcf79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:16.152958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5820c-390a-478f-b97d-fcb7878dcf79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:16.160783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5820c-390a-478f-b97d-fcb7878dcf79 service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:16.193792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1190/2372] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:35:20.964453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:21.020419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743bfb2-5005-4719-9ae2-2c00d7caaa6d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:21.021211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743bfb2-5005-4719-9ae2-2c00d7caaa6d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:21.021211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743bfb2-5005-4719-9ae2-2c00d7caaa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:21.080183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7743bfb2-5005-4719-9ae2-2c00d7caaa6d None None] MFA Rules not processed for user `a3099b72043c41ce8daa9bf8457efde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:21.083900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7743bfb2-5005-4719-9ae2-2c00d7caaa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:21.207203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d1df7-abb5-4bbc-8b82-befc5745dc3d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:21.218797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:21.220158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:21.220743 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:21.221544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] PATH_INFO: `/v3/users/00f4533041554cd9be9eaccd53d8fbc3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:21.223652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f4533041554cd9be9eaccd53d8fbc3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:21.226545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:21.278924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:21.327939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1191/2373] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:21.344376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f4533041554cd9be9eaccd53d8fbc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:21.345234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f4533041554cd9be9eaccd53d8fbc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:21.358406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f4533041554cd9be9eaccd53d8fbc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:21.380011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f4533041554cd9be9eaccd53d8fbc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:21.388951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f4533041554cd9be9eaccd53d8fbc3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:21.399588 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1183/2374] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:20 2022] DELETE /identity/v3/users/00f4533041554cd9be9eaccd53d8fbc3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:21.402568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:21.403242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:21.403743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:21.435521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:21.437040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:21.667168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1192/2375] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:21.681820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:21.708107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:21.928897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0910-7063-42d4-be30-69f3f7891e54 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:21.939517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c53e-4d60-4d42-b10d-4387ecf73d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:21.940317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c53e-4d60-4d42-b10d-4387ecf73d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:21.945762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c53e-4d60-4d42-b10d-4387ecf73d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:21.948841 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c53e-4d60-4d42-b10d-4387ecf73d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:21.992453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3c53e-4d60-4d42-b10d-4387ecf73d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:21.994592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3c53e-4d60-4d42-b10d-4387ecf73d4b service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:22.050044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1184/2376] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:23.047421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.049712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:23.072776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaf484-269d-48ea-9dcb-b7ddf19aa11a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.082047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.082947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.083220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.083717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] PATH_INFO: `/v3/projects/daeb43587c294cc2b1679d75e9c07236` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.085034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daeb43587c294cc2b1679d75e9c07236)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.087035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.157568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daeb43587c294cc2b1679d75e9c07236', 'request_id': 'req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:23.169814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daeb43587c294cc2b1679d75e9c07236', 'request_id': 'req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:23.183684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daeb43587c294cc2b1679d75e9c07236', 'request_id': 'req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:23.184750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:23.199974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] The token cache is being invalidate because project daeb43587c294cc2b1679d75e9c07236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:23.200513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:23.202374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-d8bcd8ec-22f1-46ab-8b81-bf1457b76d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:23.207700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1193/2377] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:23 2022] DELETE /identity/v3/projects/daeb43587c294cc2b1679d75e9c07236 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:23.210868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.211468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.211468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.240982 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:23.243447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:23.344697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1185/2378] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:23.348662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.349224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.349945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.374085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:23.375346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:23.384207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1194/2379] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:23.390587 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.400437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db50aa-5733-4dd6-a788-47fafb8ecba5 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.405184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.405855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.406138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.406416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.407144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:35:23.407842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.409550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.423100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1186/2380] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:35:23.428579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.438656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65df1f-f8a4-4998-8e43-84060410c5ff None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.444109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.444775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.445058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.445334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.446041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.448040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.477893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1195/2381] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:23 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:23.482096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.493140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074ef0-f9ce-4641-afeb-25e12c7cdcfc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.521489 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:23.561024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.561783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.562230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.562632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.563557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.570758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.596341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1187/2382] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:23 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:23.601730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.625811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d8fe-1122-41a9-8fad-bd34beca2ff9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.641056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.642331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.642859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.643360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.645612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.648450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.669755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1196/2383] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:23.675362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.689749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0faa0b-91ab-422d-851a-cf308651155a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.699644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c379a2-7cc4-4c02-822c-893060c147fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.700405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c379a2-7cc4-4c02-822c-893060c147fc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.700694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c379a2-7cc4-4c02-822c-893060c147fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.702644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c379a2-7cc4-4c02-822c-893060c147fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.704070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c379a2-7cc4-4c02-822c-893060c147fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.706678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c379a2-7cc4-4c02-822c-893060c147fc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.726631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1188/2384] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:35:23.728224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:23.761154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674640-ec95-4e42-82cc-2d098ba07808 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:23.774041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:23.775128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.775749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.776013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] PATH_INFO: `/v3/projects/396d7afb03394dae8e1b15a840e6c43e/users/fe724b46eb4c46f98956ac90dba68c5e/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.835410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=396d7afb03394dae8e1b15a840e6c43e, user_id=fe724b46eb4c46f98956ac90dba68c5e, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:23.840154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:23.873395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1197/2385] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:23 2022] PUT /identity/v3/projects/396d7afb03394dae8e1b15a840e6c43e/users/fe724b46eb4c46f98956ac90dba68c5e/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:23.882478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:23.882899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:23.883321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:23.974411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] MFA Rules not processed for user `fe724b46eb4c46f98956ac90dba68c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:23.976802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:24.157814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1189/2386] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:24.164848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:24.306541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b7f58-f524-4cda-872f-00598b02d6ff admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:24.315842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:24.316984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:24.317387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:24.317814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:24.318928 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:24.322860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:24.367411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1198/2387] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:24 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:35:24.373067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:24.404643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f6ddd-f776-41f0-8250-b0019ddcc32b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:24.533260 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:24.534037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:24.534338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:24.534629 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:24.536318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:24.539419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:24.607655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1190/2388] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:24 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:24.613806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:24.643029 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c0fc-98c3-46de-abaa-31ccb42e2016 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:24.651643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:24.652970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:24.653509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:24.654055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:24.655532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:24.658295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:24.691719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1199/2389] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:24.693060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:24.705692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3b512-362f-4b0c-97a6-fbb6f6216aba admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:24.712308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:24.713939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:24.714576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:24.715152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] PATH_INFO: `/v3/projects/d30a30c1b6604f3996e0768eb8e59bb1/users/a345df665bd0456bbf61d53ace4e4065/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:24.749987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30a30c1b6604f3996e0768eb8e59bb1, user_id=a345df665bd0456bbf61d53ace4e4065, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:24.756873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:24.775981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:24.789932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1191/2390] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:24 2022] PUT /identity/v3/projects/d30a30c1b6604f3996e0768eb8e59bb1/users/a345df665bd0456bbf61d53ace4e4065/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:24.791701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:24.804835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044409-436f-4fc5-a3a3-d70bb2578461 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:24.908514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9dd96-de55-4325-91e3-276b5477f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:24.909536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9dd96-de55-4325-91e3-276b5477f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:24.909981 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9dd96-de55-4325-91e3-276b5477f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:24.910446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9dd96-de55-4325-91e3-276b5477f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:24.911367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9dd96-de55-4325-91e3-276b5477f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:24.919434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9dd96-de55-4325-91e3-276b5477f2ea admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:24.935185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1200/2391] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:24.938557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:24.970563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534fac8-963d-4dd9-b4e1-2d52fd2cf038 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:24.988639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:24.989576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:24.989864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:24.990147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] PATH_INFO: `/v3/projects/d30a30c1b6604f3996e0768eb8e59bb1/users/a345df665bd0456bbf61d53ace4e4065/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:24.992396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30a30c1b6604f3996e0768eb8e59bb1, user_id=a345df665bd0456bbf61d53ace4e4065, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:24.995117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:25.020216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1192/2392] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:24 2022] PUT /identity/v3/projects/d30a30c1b6604f3996e0768eb8e59bb1/users/a345df665bd0456bbf61d53ace4e4065/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:25.032103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:25.032409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:25.032782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:25.039953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:25.090654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] MFA Rules not processed for user `a345df665bd0456bbf61d53ace4e4065`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:25.092733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:25.237063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1201/2393] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:25.254900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:25.256988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:25.386457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f1197-b7f7-4cdb-b0c7-d0638c601007 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:25.390424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6d5c-ff34-4c1f-9834-5a7a5882b770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:25.394171 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6d5c-ff34-4c1f-9834-5a7a5882b770 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:25.395112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6d5c-ff34-4c1f-9834-5a7a5882b770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:25.395396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6d5c-ff34-4c1f-9834-5a7a5882b770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:25.527297 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6d5c-ff34-4c1f-9834-5a7a5882b770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:25.528965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6d5c-ff34-4c1f-9834-5a7a5882b770 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:25.542415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1193/2394] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:28.587079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:28.725155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b52cf1-4479-4cfa-8178-428aa86ebf4b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:28.733002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:28.734818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:28.735592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:28.736407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] PATH_INFO: `/v3/users/fe724b46eb4c46f98956ac90dba68c5e` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:28.739962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe724b46eb4c46f98956ac90dba68c5e)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:28.744559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:28.839106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe724b46eb4c46f98956ac90dba68c5e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:28.840086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe724b46eb4c46f98956ac90dba68c5e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:28.850528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe724b46eb4c46f98956ac90dba68c5e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:28.874227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe724b46eb4c46f98956ac90dba68c5e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:28.875514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe724b46eb4c46f98956ac90dba68c5e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:28.904153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1202/2395] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:28 2022] DELETE /identity/v3/users/fe724b46eb4c46f98956ac90dba68c5e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:28.910344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:28.911247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:28.911247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:28.938715 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:28.940907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:29.046827 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1194/2396] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:29.058454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:29.060455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:29.080301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:29.141716 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7601a-cca5-4d15-aad7-fbc72ce06cfc admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:29.146467 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:29.147143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:29.147429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:29.147750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:29.157939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:29.160375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:29.171499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1203/2397] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:29.604727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:29.606735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:29.628954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779472c5-cba6-432b-a1fd-c23934bce7a7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:29.633925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:29.634804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:29.635107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:29.635374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] PATH_INFO: `/v3/projects/396d7afb03394dae8e1b15a840e6c43e` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:29.636658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396d7afb03394dae8e1b15a840e6c43e)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:29.639658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:29.688559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:29.703683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396d7afb03394dae8e1b15a840e6c43e', 'request_id': 'req-1585ff67-5164-4268-b43b-24016b6ed087'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.711280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396d7afb03394dae8e1b15a840e6c43e', 'request_id': 'req-1585ff67-5164-4268-b43b-24016b6ed087'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.718303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396d7afb03394dae8e1b15a840e6c43e', 'request_id': 'req-1585ff67-5164-4268-b43b-24016b6ed087'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.737350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] The token cache is being invalidate because project 396d7afb03394dae8e1b15a840e6c43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:29.737649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.738320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.739923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1195/2398] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:29 2022] DELETE /identity/v3/projects/396d7afb03394dae8e1b15a840e6c43e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:29.744499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:29.763475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ceb4e-7278-4cf9-a6c1-88b01ba0f092 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:29.827998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:29.829534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:29.829534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:29.829534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] PATH_INFO: `/v3/users/a345df665bd0456bbf61d53ace4e4065` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:29.831406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a345df665bd0456bbf61d53ace4e4065)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:29.833481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:29.898304 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a345df665bd0456bbf61d53ace4e4065'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.899712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a345df665bd0456bbf61d53ace4e4065'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.911186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a345df665bd0456bbf61d53ace4e4065'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.927478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a345df665bd0456bbf61d53ace4e4065'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.928464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a01551a8-b6de-4cf0-a048-3dc2f6ca0338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a345df665bd0456bbf61d53ace4e4065'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:29.943599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1204/2399] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:29 2022] DELETE /identity/v3/users/a345df665bd0456bbf61d53ace4e4065 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:30.312307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:30.314117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:30.331327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585ff67-5164-4268-b43b-24016b6ed087 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:30.412852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:30.413751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:30.414039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:30.414323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] PATH_INFO: `/v3/projects/d30a30c1b6604f3996e0768eb8e59bb1` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:30.415577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30a30c1b6604f3996e0768eb8e59bb1)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:30.417567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:30.482860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30a30c1b6604f3996e0768eb8e59bb1', 'request_id': 'req-1a4304f9-3d72-47d3-9db4-c4eb5d512408'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:30.490539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30a30c1b6604f3996e0768eb8e59bb1', 'request_id': 'req-1a4304f9-3d72-47d3-9db4-c4eb5d512408'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:30.498965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30a30c1b6604f3996e0768eb8e59bb1', 'request_id': 'req-1a4304f9-3d72-47d3-9db4-c4eb5d512408'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:30.516968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] The token cache is being invalidate because project d30a30c1b6604f3996e0768eb8e59bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:30.517386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:30.518186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-1a4304f9-3d72-47d3-9db4-c4eb5d512408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:30.520411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1196/2400] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:30 2022] DELETE /identity/v3/projects/d30a30c1b6604f3996e0768eb8e59bb1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:35:30.526954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:30.527258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:30.527535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:30.558279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:30.559416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:30.637959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:30.749852 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1205/2401] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:30.761330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:30.761624 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:30.761917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:30.796505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:30.798724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:30.813150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1197/2402] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:30.817368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:30.827330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e080ab-c122-4487-b18b-9c4782d8321d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:30.833448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:30.834155 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:30.834581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:30.834862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:30.835602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:35:30.835935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:30.837596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:30.853743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1206/2403] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:35:30.858201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:30.867777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5eaa8-12b0-4bcd-b73d-df827a747b94 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:30.875568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:30.876279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:30.876701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:30.876981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:30.877950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:30.880599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:30.935712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1198/2404] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:30 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:30.940443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:30.966072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0f4a-76e6-406b-8f24-e7e7a4b23c92 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.056344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.057127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.057489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.057916 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.058699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.060985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.091978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1207/2405] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:30 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:31.096398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.122439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017ceac-f744-445f-9207-b2e730aafab7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.128477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.129270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.129638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.130758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.130937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.132703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.144888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1199/2406] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:35:31.148949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.163280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d932dca-e0eb-428b-beea-63d6ce52b5fc admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.169171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac473-b71f-410c-8ed9-2a395872b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.169647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac473-b71f-410c-8ed9-2a395872b613 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.169936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac473-b71f-410c-8ed9-2a395872b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.170216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac473-b71f-410c-8ed9-2a395872b613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.170957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac473-b71f-410c-8ed9-2a395872b613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.172636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac473-b71f-410c-8ed9-2a395872b613 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.191421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1208/2407] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:31.194524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.209599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323ae7b-ec38-4096-9223-81fe333d410e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.214812 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.216362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.216820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.217169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] PATH_INFO: `/v3/projects/c0779559f84341a58f13dc5b79517f6d/users/22b63d4472194d139a7a7a20aeb17976/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.232613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:31.237074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0779559f84341a58f13dc5b79517f6d, user_id=22b63d4472194d139a7a7a20aeb17976, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.247759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.260331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1200/2408] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:31 2022] PUT /identity/v3/projects/c0779559f84341a58f13dc5b79517f6d/users/22b63d4472194d139a7a7a20aeb17976/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:31.273156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.273755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.274353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.316678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] MFA Rules not processed for user `22b63d4472194d139a7a7a20aeb17976`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:31.318007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:31.422703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1209/2409] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:31.427931 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.521299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc95ebf-b2f6-488e-9697-68e7176a881b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.527244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.527972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.528372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.528655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.529585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.532185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.576938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1201/2410] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:31 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:31.582690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.624690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1627-b8aa-4cd9-9333-275e952f0354 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.677742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:31.744974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.749974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.749974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.749974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.749974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.749974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.775827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1210/2411] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:31 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:31.778887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.790758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8dab5-e93f-4a9b-88a5-b6b945fa0426 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.797001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.797936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.798061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.798299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.799037 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.800814 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.816598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1202/2412] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:31.819642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.839064 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26de0ad-7f71-4275-bb67-21ca1fe8ab7e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.845599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14742b-2fef-4114-9893-1de25c712028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.846339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14742b-2fef-4114-9893-1de25c712028 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.846680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14742b-2fef-4114-9893-1de25c712028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.846949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14742b-2fef-4114-9893-1de25c712028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.847735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14742b-2fef-4114-9893-1de25c712028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.849515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14742b-2fef-4114-9893-1de25c712028 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.863874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1211/2413] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:31.865092 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:31.880314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c7388-f66a-4fe9-a4e8-5b189c39353f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:31.886257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:31.888438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.889090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.889658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] PATH_INFO: `/v3/projects/d901be1bf5ca4821a0ad580655e78d6a/users/596d717704e64e0298dd5ac5ceb64870/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.917498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d901be1bf5ca4821a0ad580655e78d6a, user_id=596d717704e64e0298dd5ac5ceb64870, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:31.920790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:31.939368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1203/2414] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:31 2022] PUT /identity/v3/projects/d901be1bf5ca4821a0ad580655e78d6a/users/596d717704e64e0298dd5ac5ceb64870/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:35:31.958993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:31.960031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:31.960325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:31.994139 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] MFA Rules not processed for user `596d717704e64e0298dd5ac5ceb64870`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:31.995398 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:32.134207 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1212/2415] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:32.140873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:32.311418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf4b55-cca2-413c-a0a9-25dc7ec5bca4 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:32.330010 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:32.331279 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:32.331849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:32.332379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:32.333711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:32.337977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:32.399077 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1204/2416] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:35:32 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:35:32.404420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:32.417375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962aa5e-8a5f-4da6-8496-20c73fe76906 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:32.532299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:32.533230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:32.533579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:32.534405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:32.535423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:32.537189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:32.569769 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1213/2417] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:35:32 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:35:32.573973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:32.588087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8be11-9d9e-4bce-918e-d2d668d9f409 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:32.599437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:32.601083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:32.601843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:32.602622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:32.604254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:32.607949 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:32.626783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1205/2418] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:32.628482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:32.642023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403dcf-1d95-4fe9-a8dc-f30f6ff8115f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:32.653308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:32.655032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:32.655453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:32.657169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] PATH_INFO: `/v3/projects/529d49a07fb64a5f8a756007a6e468d2/users/8ed7e6d4bacb4a4db4fec10c16bba0c8/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:32.721738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529d49a07fb64a5f8a756007a6e468d2, user_id=8ed7e6d4bacb4a4db4fec10c16bba0c8, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:32.726622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:32.743740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:32.767681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1214/2419] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:32 2022] PUT /identity/v3/projects/529d49a07fb64a5f8a756007a6e468d2/users/8ed7e6d4bacb4a4db4fec10c16bba0c8/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:32.771965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:32.789507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081edb34-3e2b-4335-94e1-fffc647069e0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:32.813660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:32.955520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48920bc3-5100-482b-b232-19dfd974b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:32.957995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920bc3-5100-482b-b232-19dfd974b049 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:32.958674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920bc3-5100-482b-b232-19dfd974b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:32.959241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920bc3-5100-482b-b232-19dfd974b049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:32.961079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48920bc3-5100-482b-b232-19dfd974b049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:32.964675 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48920bc3-5100-482b-b232-19dfd974b049 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:32.989153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1206/2420] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:35:32.994374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:33.017851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80eac-33b5-4fef-a850-4d61603b65e1 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:33.024491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:33.025388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:33.025672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:33.025979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] PATH_INFO: `/v3/projects/529d49a07fb64a5f8a756007a6e468d2/users/8ed7e6d4bacb4a4db4fec10c16bba0c8/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:33.038135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=529d49a07fb64a5f8a756007a6e468d2, user_id=8ed7e6d4bacb4a4db4fec10c16bba0c8, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:33.040057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:33.070343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1215/2421] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:35:32 2022] PUT /identity/v3/projects/529d49a07fb64a5f8a756007a6e468d2/users/8ed7e6d4bacb4a4db4fec10c16bba0c8/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:35:33.080447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:33.081500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:33.081856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:33.120689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] MFA Rules not processed for user `8ed7e6d4bacb4a4db4fec10c16bba0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:33.120689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:33.222972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1207/2422] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:33.231842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:33.235095 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:33.372968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61237d87-dd1e-4020-b46e-81fce49cc30c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:33.383156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc908-df8a-424e-8eb6-4fdd475e7d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:33.384081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc908-df8a-424e-8eb6-4fdd475e7d20 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:33.384390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc908-df8a-424e-8eb6-4fdd475e7d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:33.384659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc908-df8a-424e-8eb6-4fdd475e7d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:33.517190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cc908-df8a-424e-8eb6-4fdd475e7d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:33.519273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cc908-df8a-424e-8eb6-4fdd475e7d20 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:33.530403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1216/2423] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:35:35.560684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:35.574913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612beb31-8226-4935-a378-005b0baf8f2e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:35.580594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af76d18-1662-4752-a571-6db990ffce32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:35.581285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76d18-1662-4752-a571-6db990ffce32 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:35.582660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76d18-1662-4752-a571-6db990ffce32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:35.582660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76d18-1662-4752-a571-6db990ffce32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:35.654520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:35.655014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:35.655098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:35.686746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:35.688115 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:35.705519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af76d18-1662-4752-a571-6db990ffce32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:35.707605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af76d18-1662-4752-a571-6db990ffce32 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:35.719806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1208/2424] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:35.812122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1217/2425] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:36.107555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:36.108431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:36.109006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:36.244984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:36.247131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:36.313412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:36.314711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:36.323236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:36.342735 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:36.394999 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553056-324d-4f4f-b277-ccf438a3c41c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:36.402901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:36.403945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:36.404254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:36.404537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:36.419880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:36.422804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:36.442335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1218/2426] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:36.577759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1209/2427] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:36.675018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:36.682117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:36.887920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2df8e-dc9f-41ea-8794-6eec93d1654a service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:36.900470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c15c0-b405-41d2-b3ef-2dd4bc97a9a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:36.901325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c15c0-b405-41d2-b3ef-2dd4bc97a9a7 service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:36.901613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c15c0-b405-41d2-b3ef-2dd4bc97a9a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:36.902100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c15c0-b405-41d2-b3ef-2dd4bc97a9a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:36.919244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c15c0-b405-41d2-b3ef-2dd4bc97a9a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:36.921392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c15c0-b405-41d2-b3ef-2dd4bc97a9a7 service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:36.933485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1219/2428] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:35:37.028611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:37.045106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d9701-4058-4997-bba4-a18c451f4ab4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:37.049632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:37.050487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:37.051120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:37.051562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:37.064302 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:37.067792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:37.109291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1210/2429] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:35:39.847728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:39.848322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:39.848322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:39.900780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:39.902320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:39.920998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1220/2430] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:39.938193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:39.940978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:39.974296 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a143d0-5f68-469b-a9eb-004244874056 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:40.008415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4658a-5623-4d73-987f-f51974b4892b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:40.010817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4658a-5623-4d73-987f-f51974b4892b service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:40.012927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4658a-5623-4d73-987f-f51974b4892b service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:40.013495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4658a-5623-4d73-987f-f51974b4892b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:40.029474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4658a-5623-4d73-987f-f51974b4892b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:40.031258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4658a-5623-4d73-987f-f51974b4892b service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:40.049842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1211/2431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:35:41.665440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:41.678156 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d024-9589-4816-b126-95c8dee4be39 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:41.683352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:41.684279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:41.684741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:41.685186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] PATH_INFO: `/v3/users/22b63d4472194d139a7a7a20aeb17976` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:41.689192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b63d4472194d139a7a7a20aeb17976)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:41.692140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:41.794478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b63d4472194d139a7a7a20aeb17976'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:41.795454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b63d4472194d139a7a7a20aeb17976'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:41.805694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b63d4472194d139a7a7a20aeb17976'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:41.815860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:41.829459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b63d4472194d139a7a7a20aeb17976'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:41.831266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b63d4472194d139a7a7a20aeb17976'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:41.854154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1221/2432] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:41 2022] DELETE /identity/v3/users/22b63d4472194d139a7a7a20aeb17976 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:41.858056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:41.858616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:41.858616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:41.878409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:41.879663 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:41.951200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1212/2433] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:41.965856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:41.967387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:42.066899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974d45-deb4-46a2-b89d-7f6c4e8602ff admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:42.071047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:42.072228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:42.072228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:42.072656 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:42.087251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:42.089947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:42.113841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1222/2434] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:42.507957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:42.509486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:42.531796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852c9ab-2ee8-487d-a2de-1a797bca16b0 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:42.539898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:42.551241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:42.551770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:42.551998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] PATH_INFO: `/v3/projects/c0779559f84341a58f13dc5b79517f6d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:42.554575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0779559f84341a58f13dc5b79517f6d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:42.557619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:42.618913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0779559f84341a58f13dc5b79517f6d', 'request_id': 'req-72826a5b-1660-456b-80a4-94c78c35fc9d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.626505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0779559f84341a58f13dc5b79517f6d', 'request_id': 'req-72826a5b-1660-456b-80a4-94c78c35fc9d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.635950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0779559f84341a58f13dc5b79517f6d', 'request_id': 'req-72826a5b-1660-456b-80a4-94c78c35fc9d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.654385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] The token cache is being invalidate because project c0779559f84341a58f13dc5b79517f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:42.654679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.655406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.657441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1213/2435] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:42 2022] DELETE /identity/v3/projects/c0779559f84341a58f13dc5b79517f6d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:42.662239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:42.678240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad804ea-ef33-442b-99d2-801b226e8001 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:42.773450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:42.774392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:42.774758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:42.775099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] PATH_INFO: `/v3/users/596d717704e64e0298dd5ac5ceb64870` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:42.777165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=596d717704e64e0298dd5ac5ceb64870)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:42.791765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:42.929296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596d717704e64e0298dd5ac5ceb64870'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.930551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596d717704e64e0298dd5ac5ceb64870'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.944263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596d717704e64e0298dd5ac5ceb64870'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.966224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596d717704e64e0298dd5ac5ceb64870'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.967277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596d717704e64e0298dd5ac5ceb64870'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:42.985770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1223/2436] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:42 2022] DELETE /identity/v3/users/596d717704e64e0298dd5ac5ceb64870 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:35:43.639406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:43.640967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:43.661502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:43.669145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72826a5b-1660-456b-80a4-94c78c35fc9d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:43.761278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:43.762613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:43.762981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:43.763310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] PATH_INFO: `/v3/projects/d901be1bf5ca4821a0ad580655e78d6a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:43.764942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d901be1bf5ca4821a0ad580655e78d6a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:43.767141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:43.852783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd901be1bf5ca4821a0ad580655e78d6a', 'request_id': 'req-2f0423ef-f5a1-44bc-9d2e-0bee68739193'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:43.859635 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd901be1bf5ca4821a0ad580655e78d6a', 'request_id': 'req-2f0423ef-f5a1-44bc-9d2e-0bee68739193'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:43.867243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd901be1bf5ca4821a0ad580655e78d6a', 'request_id': 'req-2f0423ef-f5a1-44bc-9d2e-0bee68739193'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:43.884058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] The token cache is being invalidate because project d901be1bf5ca4821a0ad580655e78d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:43.884347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:43.884993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:43.886571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1214/2437] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:43 2022] DELETE /identity/v3/projects/d901be1bf5ca4821a0ad580655e78d6a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:43.892621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:43.894794 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:43.905305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:43.914068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c337-6a6e-4bb4-8288-069a379dc95c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:43.996369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:43.997308 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:43.997613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:43.997888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] PATH_INFO: `/v3/users/8ed7e6d4bacb4a4db4fec10c16bba0c8` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:43.999310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed7e6d4bacb4a4db4fec10c16bba0c8)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:44.001411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:44.085324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed7e6d4bacb4a4db4fec10c16bba0c8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.086182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed7e6d4bacb4a4db4fec10c16bba0c8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.097301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed7e6d4bacb4a4db4fec10c16bba0c8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.123657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed7e6d4bacb4a4db4fec10c16bba0c8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.123657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-751165ca-e8ed-45a4-95da-b7752221e95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed7e6d4bacb4a4db4fec10c16bba0c8'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.133189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1224/2438] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:43 2022] DELETE /identity/v3/users/8ed7e6d4bacb4a4db4fec10c16bba0c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:44.603913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:44.605544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:44.655581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0423ef-f5a1-44bc-9d2e-0bee68739193 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:44.769858 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:44.770943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:44.771270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:44.771695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] PATH_INFO: `/v3/projects/529d49a07fb64a5f8a756007a6e468d2` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:44.773928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] RBAC: Authorizing `identity:delete_project(project_id=529d49a07fb64a5f8a756007a6e468d2)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:44.776707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:44.840857 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:44.865860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529d49a07fb64a5f8a756007a6e468d2', 'request_id': 'req-57089a9b-fb47-4b79-9322-5f2088ea863a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.876932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529d49a07fb64a5f8a756007a6e468d2', 'request_id': 'req-57089a9b-fb47-4b79-9322-5f2088ea863a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.899002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529d49a07fb64a5f8a756007a6e468d2', 'request_id': 'req-57089a9b-fb47-4b79-9322-5f2088ea863a'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.917331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] The token cache is being invalidate because project 529d49a07fb64a5f8a756007a6e468d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:44.917712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.920055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:44.935648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1215/2439] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:44 2022] DELETE /identity/v3/projects/529d49a07fb64a5f8a756007a6e468d2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:46.494302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de847d-450b-40f5-8def-13d64e716432 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:46.495054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de847d-450b-40f5-8def-13d64e716432 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:46.495054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de847d-450b-40f5-8def-13d64e716432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:46.521706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-44de847d-450b-40f5-8def-13d64e716432 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:46.523450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-44de847d-450b-40f5-8def-13d64e716432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:46.609243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1225/2440] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:46.636309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:46.638342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:46.732421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089a9b-fb47-4b79-9322-5f2088ea863a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:46.739311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb74d6-b0a5-4c70-bb36-cf30e5f92e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:46.740036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb74d6-b0a5-4c70-bb36-cf30e5f92e3f service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:46.740327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb74d6-b0a5-4c70-bb36-cf30e5f92e3f service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:46.740612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb74d6-b0a5-4c70-bb36-cf30e5f92e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:46.751162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb74d6-b0a5-4c70-bb36-cf30e5f92e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:46.754230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb74d6-b0a5-4c70-bb36-cf30e5f92e3f service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:46.768447 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1216/2441] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:47.885045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de847d-450b-40f5-8def-13d64e716432 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:47.886549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-44de847d-450b-40f5-8def-13d64e716432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:47.929597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:48.006355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de847d-450b-40f5-8def-13d64e716432 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:48.010512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:48.011300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:48.011682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:48.011966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:48.014058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:48.162371 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:48.164650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:48.180577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1226/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:48.619548 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3d2c-a6bd-4be0-85bc-77e1364fc81e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:48.621163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3d2c-a6bd-4be0-85bc-77e1364fc81e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:48.621894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3d2c-a6bd-4be0-85bc-77e1364fc81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:48.664845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-256b3d2c-a6bd-4be0-85bc-77e1364fc81e None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:48.667495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-256b3d2c-a6bd-4be0-85bc-77e1364fc81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:48.763684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1217/2443] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:48.775653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:48.777320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:48.925053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009aadc-b91e-47e4-bde7-c3a87349085e service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:48.939061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:48.943092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:48.943411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:48.946144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:48.972754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:48.976610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:48.989453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1227/2444] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 16:35:49.826973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5c82-383a-4d8e-9c3a-6de02eb722d3 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:49.827661 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5c82-383a-4d8e-9c3a-6de02eb722d3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:49.827967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5c82-383a-4d8e-9c3a-6de02eb722d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:49.854612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ec4d5c82-383a-4d8e-9c3a-6de02eb722d3 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:49.857082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ec4d5c82-383a-4d8e-9c3a-6de02eb722d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:49.873598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1218/2445] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 19 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:49.891701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:49.911381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e9cc-2d60-45a5-849e-c763194816e7 service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:49.929409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:49.930076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:49.930497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:49.933538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:49.947222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:49.949254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:49.965607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1228/2446] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:35:50.294542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f13235-dcee-4d4c-8e2c-a1969f107858 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:50.294832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f13235-dcee-4d4c-8e2c-a1969f107858 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:50.295352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f13235-dcee-4d4c-8e2c-a1969f107858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:50.315761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-70f13235-dcee-4d4c-8e2c-a1969f107858 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:50.317392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-70f13235-dcee-4d4c-8e2c-a1969f107858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:50.333067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1219/2447] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:50.344870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:50.357131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c79d-4b95-43c6-8244-1320c9585cdc service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:50.366654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:50.367837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:50.368240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:50.368721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:50.379602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:50.385439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:50.399902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1229/2448] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:35:51.163889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10d49-39d4-4276-b166-15c2b9272720 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:51.164437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10d49-39d4-4276-b166-15c2b9272720 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:51.164671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10d49-39d4-4276-b166-15c2b9272720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:51.212287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-cef10d49-39d4-4276-b166-15c2b9272720 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:51.213559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cef10d49-39d4-4276-b166-15c2b9272720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:51.242512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1220/2449] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 19 16:35:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:51.339100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:51.358757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406de1d-4754-46c9-8f49-a98037f058ee service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:51.377616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:51.378230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:51.379751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:51.380965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:51.405300 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:51.406968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:51.435005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1230/2450] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:35:51.873572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:51.874307 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:51.874870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:51.928521 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:51.930959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:51.941646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1221/2451] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:51.961551 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:51.964295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:51.996297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953338d-1663-4334-be3f-1d6657302d5a service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:52.003923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966db46-6817-4317-ba74-20a76a3b166c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:52.004894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966db46-6817-4317-ba74-20a76a3b166c service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:52.005887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966db46-6817-4317-ba74-20a76a3b166c service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:52.006401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966db46-6817-4317-ba74-20a76a3b166c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:52.047452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966db46-6817-4317-ba74-20a76a3b166c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:52.049244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966db46-6817-4317-ba74-20a76a3b166c service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:52.076313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1231/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:54.493492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:54.496948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:54.514415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca573-f695-4907-9429-fae0259cb4a3 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:54.524159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:54.525572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:54.526042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:54.526653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] PATH_INFO: `/v3/users/e309fc5b2c7d4908a5bd8c461c60c511` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:54.528796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e309fc5b2c7d4908a5bd8c461c60c511)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:54.531540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:54.563545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:54.619864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e309fc5b2c7d4908a5bd8c461c60c511'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:54.622596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e309fc5b2c7d4908a5bd8c461c60c511'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:54.662797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e309fc5b2c7d4908a5bd8c461c60c511'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:54.755592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e309fc5b2c7d4908a5bd8c461c60c511'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:54.803130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e309fc5b2c7d4908a5bd8c461c60c511'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:54.826838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1222/2453] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:35:54 2022] DELETE /identity/v3/users/e309fc5b2c7d4908a5bd8c461c60c511 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:54.832321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:54.832894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:54.832894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:54.870288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:54.872493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:54.885320 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:55.080899 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1232/2454] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:55.122644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:55.124376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:55.304420 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212fc28-022d-4d6d-8dfe-3b15004a6e92 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:55.313914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37639d1-8777-4d03-a9b7-14752a05f99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:55.315136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37639d1-8777-4d03-a9b7-14752a05f99d service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:55.315418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37639d1-8777-4d03-a9b7-14752a05f99d service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:55.318241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37639d1-8777-4d03-a9b7-14752a05f99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:55.346555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37639d1-8777-4d03-a9b7-14752a05f99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:55.349467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37639d1-8777-4d03-a9b7-14752a05f99d service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:55.414128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1223/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:55.757801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:55.759295 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:55.787640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71827b7-fce3-405e-9aa3-40179fd41688 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:55.795065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:55.796851 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:55.797146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:55.797427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] PATH_INFO: `/v3/projects/9b045aa8bca145de9ab17a7810d15ee1` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:55.813188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b045aa8bca145de9ab17a7810d15ee1)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:55.817727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:55.907414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b045aa8bca145de9ab17a7810d15ee1', 'request_id': 'req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:55.916534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b045aa8bca145de9ab17a7810d15ee1', 'request_id': 'req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:55.925513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b045aa8bca145de9ab17a7810d15ee1', 'request_id': 'req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:55.953915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] The token cache is being invalidate because project 9b045aa8bca145de9ab17a7810d15ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:35:55.954537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:55.956026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:35:55.958974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1233/2456] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:35:55 2022] DELETE /identity/v3/projects/9b045aa8bca145de9ab17a7810d15ee1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:35:56.351895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242b17-9349-4b76-9cc9-3f58ed344253 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:56.360213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242b17-9349-4b76-9cc9-3f58ed344253 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:56.364182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242b17-9349-4b76-9cc9-3f58ed344253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:56.436597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8c242b17-9349-4b76-9cc9-3f58ed344253 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:56.447461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8c242b17-9349-4b76-9cc9-3f58ed344253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:56.586957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1224/2457] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:35:56.603680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:56.605449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:56.772212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d88ee-ace7-4538-a7dd-fd89b84dbe66 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:56.772459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:56.773748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:56.773748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:56.773748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:56.784942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:56.786610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:56.809855 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1234/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:35:59.070652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a8cfa-dfee-4f2c-9fdc-797d11325e3b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:59.071173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a8cfa-dfee-4f2c-9fdc-797d11325e3b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:59.071264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a8cfa-dfee-4f2c-9fdc-797d11325e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:59.091446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bf5a8cfa-dfee-4f2c-9fdc-797d11325e3b None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:59.092787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bf5a8cfa-dfee-4f2c-9fdc-797d11325e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:59.135738 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:59.153474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1225/2459] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 19 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:59.167355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:59.168859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:59.194995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:59.260534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2679be5-8e8f-46d5-b926-4289a5b90d9f service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:59.269590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:59.270261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:59.270549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:59.270829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:59.280435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:59.282074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:59.293707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1235/2460] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:35:59.518145 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:59.518435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:59.518719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:59.538672 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:35:59.539943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:35:59.550221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1226/2461] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:35:59.593529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:35:59.616723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74215-ff98-4d0a-a9f5-2088c7b790ba service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:35:59.622252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:35:59.622910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:35:59.623376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:35:59.623483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:35:59.632850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:35:59.634480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:35:59.648885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1236/2462] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:01.396418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:01.397872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:01.410547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6c05-fa58-4fbb-8a5f-e2a672656445 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:01.416336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:01.417237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:01.417520 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:01.417806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] PATH_INFO: `/v3/users/a9c3307d1ae5495ea2d0790eb39e3b48` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:01.419042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c3307d1ae5495ea2d0790eb39e3b48)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:01.421104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:01.469772 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c3307d1ae5495ea2d0790eb39e3b48'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.471003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c3307d1ae5495ea2d0790eb39e3b48'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.481311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c3307d1ae5495ea2d0790eb39e3b48'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.494039 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c3307d1ae5495ea2d0790eb39e3b48'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.500945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9298fc5b-e735-47b0-968d-91222981fd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c3307d1ae5495ea2d0790eb39e3b48'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.506973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1227/2463] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:36:01 2022] DELETE /identity/v3/users/a9c3307d1ae5495ea2d0790eb39e3b48 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:36:01.687466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:01.698173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756062d-2ac7-4219-acc1-8e275f6fb099 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:01.758500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:01.759478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:01.759891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:01.760277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] PATH_INFO: `/v3/projects/0acbede9739c43cba0a9071abe387837` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:01.761672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acbede9739c43cba0a9071abe387837)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:01.764062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:01.815754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acbede9739c43cba0a9071abe387837', 'request_id': 'req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.824529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acbede9739c43cba0a9071abe387837', 'request_id': 'req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.831592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acbede9739c43cba0a9071abe387837', 'request_id': 'req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.845910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] The token cache is being invalidate because project 0acbede9739c43cba0a9071abe387837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:36:01.846220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.847096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c59b31a6-68cd-444c-bbe9-fc8eee1f90d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:01.849921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1237/2464] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:36:01 2022] DELETE /identity/v3/projects/0acbede9739c43cba0a9071abe387837 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:36:01.855020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:01.855312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:01.855607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:01.877324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:01.878482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:01.963686 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1228/2465] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:01.971273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:01.971566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:01.971882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:01.990834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:01.992124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:02.001932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1238/2466] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:02.006114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.016394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0224e7-6c27-4c20-b53e-ad47e7eafe80 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.023950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.024950 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.025352 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.025860 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.027273 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:36:02.027737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.029890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.043980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1229/2467] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:36:02.048746 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.058077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f739a7-3d1f-433a-bb2f-19ca32b43c86 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.062930 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.063589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.064438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.064717 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.065407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.067548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.084693 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:02.103877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1239/2468] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:36:02 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:36:02.105016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.115423 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cc46-919e-4da0-9dce-1c554b074f0f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.160547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:02.179932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.180647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.180936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.181218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.181980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.184266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.209172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1230/2469] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:36:02 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:36:02.210434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.221675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682bb88-9d06-46ac-b58b-2a7584b29fe4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.226561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.227256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.227542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.227861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.228610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.230297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.242221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1240/2470] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:36:02.246492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.259194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6493-9565-44ef-963d-97d9bafcec1e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.264253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d9e6e-cc24-4f9c-89a9-869001935fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.264906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d9e6e-cc24-4f9c-89a9-869001935fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.265191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d9e6e-cc24-4f9c-89a9-869001935fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.265465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d9e6e-cc24-4f9c-89a9-869001935fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.266191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d9e6e-cc24-4f9c-89a9-869001935fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.267842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d9e6e-cc24-4f9c-89a9-869001935fdc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.278497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1231/2471] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:36:02.282729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.292983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6dfe-add0-440b-b029-e0b6c1d95ab6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.297905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.299328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.299612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.299932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] PATH_INFO: `/v3/projects/caed44b06114446f8d87f1585095f9d9/users/9db379b642da4d91a42f0a09dd9cb248/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.315703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caed44b06114446f8d87f1585095f9d9, user_id=9db379b642da4d91a42f0a09dd9cb248, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.318463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.332464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1241/2472] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:36:02 2022] PUT /identity/v3/projects/caed44b06114446f8d87f1585095f9d9/users/9db379b642da4d91a42f0a09dd9cb248/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:36:02.342820 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.343135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.343411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.371802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] MFA Rules not processed for user `9db379b642da4d91a42f0a09dd9cb248`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:02.373020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:02.439965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1232/2473] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:02.451286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:02.452982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:02.531697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d19b-b1b4-402e-935c-11972357d853 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:02.536174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ce5f5-defa-4a19-a76a-af7a87d2026f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:02.536824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce5f5-defa-4a19-a76a-af7a87d2026f service glance] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:02.537107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce5f5-defa-4a19-a76a-af7a87d2026f service glance] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:02.537383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce5f5-defa-4a19-a76a-af7a87d2026f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:02.546561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ce5f5-defa-4a19-a76a-af7a87d2026f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:02.548058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ce5f5-defa-4a19-a76a-af7a87d2026f service glance] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:02.557895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1242/2474] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:11.451002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:11.452476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:11.550625 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de493e8-9d68-442f-94be-3e5c7270f3df None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:11.557969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:11.558668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:11.558984 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:11.559291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:11.561496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:11.573700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:11.575655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:11.585379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1233/2475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:12.553648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:16.139435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53959949-b903-4833-9942-d8d6f0fc5b90 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:16.140084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53959949-b903-4833-9942-d8d6f0fc5b90 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:16.140084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53959949-b903-4833-9942-d8d6f0fc5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:16.158229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-53959949-b903-4833-9942-d8d6f0fc5b90 None None] MFA Rules not processed for user `a934ed32cc17489aa0616b6c6aadfa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:16.159348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-53959949-b903-4833-9942-d8d6f0fc5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:16.215552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1243/2476] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:21.581247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:26.208875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=25 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:28.612361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:28.682000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce1c2-5898-421d-8128-0efd17756d79 service placement] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:28.689445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:28.690436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:28.690798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:28.691153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] PATH_INFO: `/v3/users/9db379b642da4d91a42f0a09dd9cb248` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:28.692993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db379b642da4d91a42f0a09dd9cb248)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:28.694980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:28.747698 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db379b642da4d91a42f0a09dd9cb248'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:28.748555 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db379b642da4d91a42f0a09dd9cb248'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:28.757149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db379b642da4d91a42f0a09dd9cb248'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:28.770450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db379b642da4d91a42f0a09dd9cb248'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:28.778415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db379b642da4d91a42f0a09dd9cb248'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:28.785032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1234/2477] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:36:28 2022] DELETE /identity/v3/users/9db379b642da4d91a42f0a09dd9cb248 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:36:28.789543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:28.790031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:28.790138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:28.808549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:28.809668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:28.869266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1244/2478] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:28.878947 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:28.880367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:28.941696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a3cb-01bb-47b5-9e62-02b4b7f260a3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:28.945349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb113e4a-85c3-4d3c-b7a8-a90e2e7bca8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:28.945998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb113e4a-85c3-4d3c-b7a8-a90e2e7bca8e service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:28.946287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb113e4a-85c3-4d3c-b7a8-a90e2e7bca8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:28.946570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb113e4a-85c3-4d3c-b7a8-a90e2e7bca8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:28.955934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb113e4a-85c3-4d3c-b7a8-a90e2e7bca8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:28.957387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb113e4a-85c3-4d3c-b7a8-a90e2e7bca8e service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:28.966977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1235/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:29.249376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.250990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:29.268835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b6839-aeb3-4961-b6a6-abb4419767bb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.275265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.276324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.276577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.276832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] PATH_INFO: `/v3/projects/caed44b06114446f8d87f1585095f9d9` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.278648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caed44b06114446f8d87f1585095f9d9)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.281038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.334935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caed44b06114446f8d87f1585095f9d9', 'request_id': 'req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:29.340484 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caed44b06114446f8d87f1585095f9d9', 'request_id': 'req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:29.347421 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caed44b06114446f8d87f1585095f9d9', 'request_id': 'req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:29.365074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] The token cache is being invalidate because project caed44b06114446f8d87f1585095f9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:36:29.365378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:29.366327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3dd546e1-584b-4bf9-bf16-6d3b73fd1d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:36:29.368202 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1245/2480] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:36:29 2022] DELETE /identity/v3/projects/caed44b06114446f8d87f1585095f9d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:36:29.373720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.374025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.374324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.398063 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:29.399329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:29.420336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:29.470908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1236/2481] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:29.479011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.479388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.479776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.498965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:29.500260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:29.512453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1246/2482] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:29.513892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.525185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10067-bf03-483f-b44e-9eb10d426e85 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.529844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.530578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.530928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.531299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.532183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:36:29.532559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.534287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.550567 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1237/2483] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:36:29.551290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.560772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be14c0-81e6-4c8d-87db-625a4bbc098b None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.566442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.567116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.568146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.568146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.568434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.570345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.597283 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1247/2484] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:36:29 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:36:29.601386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.611899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8563b-bb3b-4bef-bff3-25c25e5e8534 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.673669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.674385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.675235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.675531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.676254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.678222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.702975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1238/2485] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:36:29 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:36:29.704865 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.715085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2118-b04f-4dfb-86f7-a61ea2aa7077 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.719892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.720562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.720844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.721118 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.722664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.723672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.734577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1248/2486] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:36:29.738545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.749501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79790-4f2d-4d5a-8fd8-22703af61720 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.755053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad95002-50cf-48b5-9612-37f12f95497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.755833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad95002-50cf-48b5-9612-37f12f95497d admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.756117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad95002-50cf-48b5-9612-37f12f95497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.756394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad95002-50cf-48b5-9612-37f12f95497d admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.757125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad95002-50cf-48b5-9612-37f12f95497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.758805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad95002-50cf-48b5-9612-37f12f95497d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.771778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1239/2487] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:36:29.775962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.787389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8db7-8b44-4063-9b02-b365665e602a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:29.792532 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:29.793597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.793900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.794307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] PATH_INFO: `/v3/projects/786de04bbf76450ab82d70d486470b7d/users/a0e5c42631d447a784fb83e64d57fe9f/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.811968 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=786de04bbf76450ab82d70d486470b7d, user_id=a0e5c42631d447a784fb83e64d57fe9f, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:29.815117 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:29.837934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1249/2488] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:36:29 2022] PUT /identity/v3/projects/786de04bbf76450ab82d70d486470b7d/users/a0e5c42631d447a784fb83e64d57fe9f/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:36:29.848217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87204adc-ce75-4f6d-8f5a-96da96808ce1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:29.848569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87204adc-ce75-4f6d-8f5a-96da96808ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:29.848791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87204adc-ce75-4f6d-8f5a-96da96808ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:29.877942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-87204adc-ce75-4f6d-8f5a-96da96808ce1 None None] MFA Rules not processed for user `a0e5c42631d447a784fb83e64d57fe9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:29.879181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-87204adc-ce75-4f6d-8f5a-96da96808ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:29.976654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1240/2489] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:29.990688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:29.993145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:30.032375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:30.102178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5e6b-bb3f-4927-9b5b-80e94cedb8ff admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:30.106752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:30.107644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:30.107966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:30.108276 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:30.121143 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:30.122653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:30.134507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1250/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:30.194699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0c14-00c9-43ca-851d-757b02a90bee None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:30.195398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0c14-00c9-43ca-851d-757b02a90bee None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:30.195730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0c14-00c9-43ca-851d-757b02a90bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:30.221636 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-11fc0c14-00c9-43ca-851d-757b02a90bee None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:30.222697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-11fc0c14-00c9-43ca-851d-757b02a90bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:30.237965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:30.306442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1241/2491] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:30.321976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:30.323819 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:30.439195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cf9f0-729b-4ca7-bcc7-147740f7934b service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:30.463387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:30.464128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:30.464561 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:30.465014 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:30.488394 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:30.492192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:30.538862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1251/2492] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:33.525541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36821b-f7f6-4c35-a0eb-534ea69ac84a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:33.526085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36821b-f7f6-4c35-a0eb-534ea69ac84a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:33.526085 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36821b-f7f6-4c35-a0eb-534ea69ac84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:33.559926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-9c36821b-f7f6-4c35-a0eb-534ea69ac84a None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:33.561383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9c36821b-f7f6-4c35-a0eb-534ea69ac84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:33.580960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1242/2493] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:33.596278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:33.613841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed094a5f-0117-4c2c-b2aa-59468b51ad3f service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:33.621974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:33.622708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:33.623091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:33.623436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:33.635268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:33.637510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:33.660457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1252/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:36.559021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7808396-ff6d-489a-a1a6-40ddc6b9f7b4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:36.559552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7808396-ff6d-489a-a1a6-40ddc6b9f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:36.559552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7808396-ff6d-489a-a1a6-40ddc6b9f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:36.579632 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d7808396-ff6d-489a-a1a6-40ddc6b9f7b4 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:36.580837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d7808396-ff6d-489a-a1a6-40ddc6b9f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:36.588559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1243/2495] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:36.605237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:36.616978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2578360-4f8b-477c-b7e2-a30aef6085e1 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:36.622667 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:36.623312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:36.623594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:36.623901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:36.633307 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:36.634929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:36.646255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1253/2496] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:36:40.766261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87615371-ec14-4c05-8165-350d97b24ce7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:40.767314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87615371-ec14-4c05-8165-350d97b24ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:40.767859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87615371-ec14-4c05-8165-350d97b24ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:40.787859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-87615371-ec14-4c05-8165-350d97b24ce7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:40.789712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-87615371-ec14-4c05-8165-350d97b24ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:40.799007 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1244/2497] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:40.816024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:40.817636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:40.836080 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6d8c3-4040-4327-868e-6d2f09c9d817 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:40.842843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:40.843801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:40.844180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:40.844597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:40.854923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:40.856739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:40.867836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1254/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:43.955585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd56cd-febd-4c2f-9702-a2fae3161417 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:43.956072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd56cd-febd-4c2f-9702-a2fae3161417 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:43.959732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd56cd-febd-4c2f-9702-a2fae3161417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:43.983310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-45dd56cd-febd-4c2f-9702-a2fae3161417 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:43.984524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-45dd56cd-febd-4c2f-9702-a2fae3161417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:43.993695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1245/2499] 10.222.0.57 () {58 vars in 1016 bytes} [Thu May 19 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:44.011728 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:36:44.031757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2282fd8-bf1e-480b-bdd8-fefe8469cc0a service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:36:44.041738 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:36:44.042512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:44.042860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:44.043206 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:44.053658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:36:44.055740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:36:44.068215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1255/2500] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:36:44.938957 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f050d-1779-4c94-93a4-854b11ae9692 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:36:44.939226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f050d-1779-4c94-93a4-854b11ae9692 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:36:44.939509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f050d-1779-4c94-93a4-854b11ae9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:36:44.958293 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-850f050d-1779-4c94-93a4-854b11ae9692 None None] MFA Rules not processed for user `4df5c2b1e22f4c54b05eb77d9ba9818b`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:36:44.959504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-850f050d-1779-4c94-93a4-854b11ae9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:36:45.024421 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1246/2501] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:36:54.063571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=75 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:36:55.017187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=56 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:02.681212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:02.691128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ee58-a071-462e-92ce-e3e4d2132fab service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:02.696005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:02.696863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:02.697142 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:02.697443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] PATH_INFO: `/v3/users/a0e5c42631d447a784fb83e64d57fe9f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:02.698653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e5c42631d447a784fb83e64d57fe9f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:02.700627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:02.748299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e5c42631d447a784fb83e64d57fe9f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:02.748996 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e5c42631d447a784fb83e64d57fe9f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:02.756682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e5c42631d447a784fb83e64d57fe9f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:02.769279 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e5c42631d447a784fb83e64d57fe9f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:02.769925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e5c42631d447a784fb83e64d57fe9f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:02.782729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1256/2502] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:37:02 2022] DELETE /identity/v3/users/a0e5c42631d447a784fb83e64d57fe9f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:02.787323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:02.787903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:02.787903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:02.807406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:02.808708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:02.868666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1247/2503] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:02.878215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:02.879647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:02.939336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e042-1898-4562-84fc-e19c1bfe2ab4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:02.942982 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b00a3e-0d14-4dc3-affb-d7012337fcf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:02.943659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b00a3e-0d14-4dc3-affb-d7012337fcf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:02.943950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b00a3e-0d14-4dc3-affb-d7012337fcf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:02.944229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b00a3e-0d14-4dc3-affb-d7012337fcf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:02.954015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b00a3e-0d14-4dc3-affb-d7012337fcf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:02.955463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b00a3e-0d14-4dc3-affb-d7012337fcf5 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:02.965108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1257/2504] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:37:03.290497 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:03.292222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:03.315285 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b57688-86c1-40f7-b77c-28d945021061 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:03.338079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:03.339358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:03.340591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:03.341176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] PATH_INFO: `/v3/projects/786de04bbf76450ab82d70d486470b7d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:03.343592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786de04bbf76450ab82d70d486470b7d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:03.346261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:03.413319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786de04bbf76450ab82d70d486470b7d', 'request_id': 'req-bef941c8-19b2-4780-93db-a1cab3aef8c2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:03.420492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786de04bbf76450ab82d70d486470b7d', 'request_id': 'req-bef941c8-19b2-4780-93db-a1cab3aef8c2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:03.427807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786de04bbf76450ab82d70d486470b7d', 'request_id': 'req-bef941c8-19b2-4780-93db-a1cab3aef8c2'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:03.443658 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] The token cache is being invalidate because project 786de04bbf76450ab82d70d486470b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:37:03.444045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:03.444801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:03.446486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1248/2505] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:37:03 2022] DELETE /identity/v3/projects/786de04bbf76450ab82d70d486470b7d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:08.119050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:08.119686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:08.119686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:08.139369 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] MFA Rules not processed for user `a3099b72043c41ce8daa9bf8457efde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:08.141205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:08.206616 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1258/2506] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:13.440055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:14.507512 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:14.509023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:14.580714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef941c8-19b2-4780-93db-a1cab3aef8c2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:14.585368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:14.586429 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:14.586575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:14.586891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] PATH_INFO: `/v3/users/a934ed32cc17489aa0616b6c6aadfa8b` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:14.588330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a934ed32cc17489aa0616b6c6aadfa8b)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:14.590290 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:14.639115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a934ed32cc17489aa0616b6c6aadfa8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:14.640461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a934ed32cc17489aa0616b6c6aadfa8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:14.648368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a934ed32cc17489aa0616b6c6aadfa8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:14.660531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a934ed32cc17489aa0616b6c6aadfa8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:14.667367 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-93409c37-8cc4-40d6-ac9e-0c33e61d92ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a934ed32cc17489aa0616b6c6aadfa8b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:14.673402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1249/2507] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:37:14 2022] DELETE /identity/v3/users/a934ed32cc17489aa0616b6c6aadfa8b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:14.852441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:14.868986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2fb8-8965-42be-a13b-63f9984cc74c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:14.888205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:14.931509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:14.932404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:14.932679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:14.932952 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] PATH_INFO: `/v3/projects/3fda64c0251e424ca9791379c4607b76` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:14.934130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fda64c0251e424ca9791379c4607b76)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:14.936154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:14.990762 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fda64c0251e424ca9791379c4607b76', 'request_id': 'req-fcf7018e-e704-4392-89c3-279ae04a137f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:15.001783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fda64c0251e424ca9791379c4607b76', 'request_id': 'req-fcf7018e-e704-4392-89c3-279ae04a137f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:15.012477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fda64c0251e424ca9791379c4607b76', 'request_id': 'req-fcf7018e-e704-4392-89c3-279ae04a137f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:15.026256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] The token cache is being invalidate because project 3fda64c0251e424ca9791379c4607b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:37:15.026575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:15.027211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-fcf7018e-e704-4392-89c3-279ae04a137f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:15.029161 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1259/2508] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:37:14 2022] DELETE /identity/v3/projects/3fda64c0251e424ca9791379c4607b76 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:15.034480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.034807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.035091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.053807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:15.055013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:15.115241 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1250/2509] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:15.122775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.123073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.123391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.143251 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:15.144516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:15.152597 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1260/2510] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:15.156983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.166691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d634c2-2033-4e23-a921-128d686fbac2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.171791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.172440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.172726 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.173001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.173722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:37:15.174032 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.175665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.187826 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1251/2511] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:37:15.192094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.201448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7730a7-ea49-41b7-b4a4-646a7c3f4b31 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.206041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.206687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.206964 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.207236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.207953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.209860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.235254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1261/2512] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:37:15 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:37:15.239312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.250003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57977510-24ce-4128-8b44-36656b1e082b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.253731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:15.309320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.309870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.310156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.310435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.311134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.313141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.336756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1252/2513] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:37:15 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:37:15.341213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.352257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb0ac1-63a7-4616-b410-da24ebb842d5 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.361931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.362694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.362694 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.363008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.364261 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.365507 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.376579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1262/2514] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:37:15.380566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.391479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858896a6-1854-48b5-83f2-78dfb4ae9c27 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.396515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba62840-13cf-43dd-973a-c730d2705dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.397199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba62840-13cf-43dd-973a-c730d2705dea admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.397485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba62840-13cf-43dd-973a-c730d2705dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.397764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba62840-13cf-43dd-973a-c730d2705dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.398508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba62840-13cf-43dd-973a-c730d2705dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.400177 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba62840-13cf-43dd-973a-c730d2705dea admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.411374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1253/2515] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:37:15.415474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.426238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61886544-8052-4c23-ad45-e172ad8999a4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.430905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.431824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.432110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.432389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] PATH_INFO: `/v3/projects/f87439c2d6b549ada9af7e988e43dd7c/users/ea2cff2fba8b42ce99d5fe2ad59243ac/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.447891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87439c2d6b549ada9af7e988e43dd7c, user_id=ea2cff2fba8b42ce99d5fe2ad59243ac, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.450601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.468112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1263/2516] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:37:15 2022] PUT /identity/v3/projects/f87439c2d6b549ada9af7e988e43dd7c/users/ea2cff2fba8b42ce99d5fe2ad59243ac/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:15.478506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.478797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.479102 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.508510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] MFA Rules not processed for user `ea2cff2fba8b42ce99d5fe2ad59243ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:15.509731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:15.583956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1254/2517] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:15.591121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:15.593469 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:15.657165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:15.664166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2f34-6c5c-46a4-a5c3-7ae0c2a73b98 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:15.669350 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1351f-bf17-41ed-b73d-acd4ded110c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:15.669700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1351f-bf17-41ed-b73d-acd4ded110c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:15.670154 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1351f-bf17-41ed-b73d-acd4ded110c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:15.670462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1351f-bf17-41ed-b73d-acd4ded110c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:15.680965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1351f-bf17-41ed-b73d-acd4ded110c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:15.682470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1351f-bf17-41ed-b73d-acd4ded110c9 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:15.692163 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1264/2518] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:37:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:37:25.576634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:25.688040 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:25.787101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:25.849803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a3d4-05f3-4bd8-b862-11992a7635af None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:25.854463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:25.855334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:25.855644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:25.855926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] PATH_INFO: `/v3/users/ea2cff2fba8b42ce99d5fe2ad59243ac` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:25.857219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2cff2fba8b42ce99d5fe2ad59243ac)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:25.859871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:25.911712 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2cff2fba8b42ce99d5fe2ad59243ac'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:25.912368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2cff2fba8b42ce99d5fe2ad59243ac'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:25.921117 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2cff2fba8b42ce99d5fe2ad59243ac'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:25.933319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2cff2fba8b42ce99d5fe2ad59243ac'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:25.940611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2cff2fba8b42ce99d5fe2ad59243ac'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:25.946482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1255/2519] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:37:25 2022] DELETE /identity/v3/users/ea2cff2fba8b42ce99d5fe2ad59243ac => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:25.951221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:25.952123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:25.952405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:25.969342 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:25.970537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:26.032528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1265/2520] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:26.042581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:26.045740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:26.108863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6edc-04df-4293-b314-1b37e9f1762e admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:26.112557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cdaf8-bd01-4474-b5a9-66e5a97eec90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:26.113217 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cdaf8-bd01-4474-b5a9-66e5a97eec90 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:26.113507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cdaf8-bd01-4474-b5a9-66e5a97eec90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:26.113788 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cdaf8-bd01-4474-b5a9-66e5a97eec90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:26.124383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cdaf8-bd01-4474-b5a9-66e5a97eec90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:26.125852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cdaf8-bd01-4474-b5a9-66e5a97eec90 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:26.136388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1256/2521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:37:26.407007 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:26.408668 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:26.422464 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2eb94e-00e1-4873-bdbe-3a2d4d16626e None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:26.428191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:26.429150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:26.429468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:26.429776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] PATH_INFO: `/v3/projects/f87439c2d6b549ada9af7e988e43dd7c` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:26.432213 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87439c2d6b549ada9af7e988e43dd7c)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:26.433560 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:26.484195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87439c2d6b549ada9af7e988e43dd7c', 'request_id': 'req-66df9031-bd48-438c-b3c4-ec9e27c25e82'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:26.489666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87439c2d6b549ada9af7e988e43dd7c', 'request_id': 'req-66df9031-bd48-438c-b3c4-ec9e27c25e82'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:26.496164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87439c2d6b549ada9af7e988e43dd7c', 'request_id': 'req-66df9031-bd48-438c-b3c4-ec9e27c25e82'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:26.508887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] The token cache is being invalidate because project f87439c2d6b549ada9af7e988e43dd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:37:26.509180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:26.509807 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:26.511630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1266/2522] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:37:26 2022] DELETE /identity/v3/projects/f87439c2d6b549ada9af7e988e43dd7c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:30.292678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:30.293162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:30.293261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:30.311770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:30.312986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:30.329611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:30.369861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1257/2523] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 19 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:30.417521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:30.419020 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:30.497640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9031-bd48-438c-b3c4-ec9e27c25e82 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:30.502564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:30.503205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:30.503486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:30.503788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:30.512140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:30.513749 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:30.521677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1267/2524] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:37:37.505919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:37.507482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:37.587759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d7eb-85c9-4387-b3a2-752a26834809 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:37.592370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:37.593257 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:37.593542 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:37.593823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] PATH_INFO: `/v3/users/10919eea11f3411ead1facfe3e37bf6d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:37.595047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10919eea11f3411ead1facfe3e37bf6d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:37.598165 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:37.651904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10919eea11f3411ead1facfe3e37bf6d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:37.652599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10919eea11f3411ead1facfe3e37bf6d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:37.659856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10919eea11f3411ead1facfe3e37bf6d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:37.672572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10919eea11f3411ead1facfe3e37bf6d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:37.679374 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10919eea11f3411ead1facfe3e37bf6d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:37.686099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1258/2525] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:37:37 2022] DELETE /identity/v3/users/10919eea11f3411ead1facfe3e37bf6d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:37.861906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:37.875370 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f161f-2cd4-40df-b455-486206c4462f service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:37.888132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:37.940303 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:37.941170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:37.941455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:37.941732 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] PATH_INFO: `/v3/projects/6ac1676d0e514554a7cafab072f2a119` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:37.942913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac1676d0e514554a7cafab072f2a119)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:37.944880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:37.990816 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac1676d0e514554a7cafab072f2a119', 'request_id': 'req-1f3c2639-f21f-47af-afd2-16abc1ae2358'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:37.996222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac1676d0e514554a7cafab072f2a119', 'request_id': 'req-1f3c2639-f21f-47af-afd2-16abc1ae2358'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.002362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac1676d0e514554a7cafab072f2a119', 'request_id': 'req-1f3c2639-f21f-47af-afd2-16abc1ae2358'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.015435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] The token cache is being invalidate because project 6ac1676d0e514554a7cafab072f2a119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:37:38.015761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.016382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.017929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1268/2526] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:37:37 2022] DELETE /identity/v3/projects/6ac1676d0e514554a7cafab072f2a119 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:38.022168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.023685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:38.037103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e6088-2a3f-481b-8268-385734f78629 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.082437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:38.098268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.099266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.099678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.100062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] PATH_INFO: `/v3/users/66098bc299e4435a956d6b2b0f3a6604` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.101412 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66098bc299e4435a956d6b2b0f3a6604)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.103592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.151873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66098bc299e4435a956d6b2b0f3a6604'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.152547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66098bc299e4435a956d6b2b0f3a6604'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.160378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66098bc299e4435a956d6b2b0f3a6604'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.172282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66098bc299e4435a956d6b2b0f3a6604'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.179041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-4b5cac09-01d6-4e9f-b107-2130f0f8bdf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66098bc299e4435a956d6b2b0f3a6604'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.184987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1259/2527] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:37:38 2022] DELETE /identity/v3/users/66098bc299e4435a956d6b2b0f3a6604 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:38.360136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.361614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:38.376159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2639-f21f-47af-afd2-16abc1ae2358 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.435326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.436135 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.436417 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.436695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] PATH_INFO: `/v3/projects/46e4c05d7d454f8682264c958aa72263` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.437868 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e4c05d7d454f8682264c958aa72263)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.439841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.483442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:38.486583 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e4c05d7d454f8682264c958aa72263', 'request_id': 'req-218c5e45-6d86-453f-be3b-2bbc3cc1f379'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.492882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e4c05d7d454f8682264c958aa72263', 'request_id': 'req-218c5e45-6d86-453f-be3b-2bbc3cc1f379'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.499472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e4c05d7d454f8682264c958aa72263', 'request_id': 'req-218c5e45-6d86-453f-be3b-2bbc3cc1f379'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.512107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] The token cache is being invalidate because project 46e4c05d7d454f8682264c958aa72263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:37:38.512426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.513168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-218c5e45-6d86-453f-be3b-2bbc3cc1f379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:37:38.515321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1269/2528] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:37:38 2022] DELETE /identity/v3/projects/46e4c05d7d454f8682264c958aa72263 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:38.520546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.521006 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.521147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.538569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:38.539835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:38.597958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1260/2529] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:38.605826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.606116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.606416 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.625479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:38.626671 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:38.634920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1270/2530] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:38.639917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.649646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3013e1-ff54-47e0-bb40-3b96e116e2bf None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.654321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.654955 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.655245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.655530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.656329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:37:38.656646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.658263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.670057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1261/2531] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:37:38.674455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.683980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2b1a3-a7c6-42cb-9b1f-35fd07c4df15 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.689146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.689733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.690013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.690288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.690977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.692933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.718388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1271/2532] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:37:38 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:37:38.722515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.732486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7d98f-869f-4309-82f1-d0da349068ca admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.780356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:38.790778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.791445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.791782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.792064 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.792756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.794714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.818090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1262/2533] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:37:38 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:37:38.822170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.833098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887cef2-cb19-4f20-b186-cd626ef9a8ca admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.837689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.838341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.838620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.838891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.839611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.841239 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.851672 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1272/2534] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:37:38.855532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.865466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f82da1-ff0f-4630-89ac-8257d68b92b3 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.870095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce26b-cd4f-4faa-807c-6877bd1dc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.870750 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce26b-cd4f-4faa-807c-6877bd1dc09f admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.871043 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce26b-cd4f-4faa-807c-6877bd1dc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.871312 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce26b-cd4f-4faa-807c-6877bd1dc09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.872096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce26b-cd4f-4faa-807c-6877bd1dc09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.874222 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce26b-cd4f-4faa-807c-6877bd1dc09f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.884507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1263/2535] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:37:38.889601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:38.899926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b795e-7fc8-4f99-a188-94eaeda63965 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:38.904605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:38.905483 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.905785 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.906044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] PATH_INFO: `/v3/projects/36d8bfa61aa445f9a19060bea759f579/users/0991de3fb3ee4410953b8984cf16d2ea/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.921402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d8bfa61aa445f9a19060bea759f579, user_id=0991de3fb3ee4410953b8984cf16d2ea, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:38.924158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:38.937815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1273/2536] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:37:38 2022] PUT /identity/v3/projects/36d8bfa61aa445f9a19060bea759f579/users/0991de3fb3ee4410953b8984cf16d2ea/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:38.942958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c396-c6ed-4c78-b877-e4ba5e198d42 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:38.943200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c396-c6ed-4c78-b877-e4ba5e198d42 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:38.943482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c396-c6ed-4c78-b877-e4ba5e198d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:38.962612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-2ef5c396-c6ed-4c78-b877-e4ba5e198d42 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:38.963839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-2ef5c396-c6ed-4c78-b877-e4ba5e198d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:39.021653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1264/2537] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:39.031119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:39.032989 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:39.090391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd595d6-41f5-481f-8fa5-4f368bb2efd8 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:39.094193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:39.094837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:39.095124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:39.095402 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:39.104783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:39.106230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:39.116558 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1274/2538] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:37:43.430599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:43.431081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:43.431179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:43.461411 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] MFA Rules not processed for user `0991de3fb3ee4410953b8984cf16d2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:43.462933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:43.572953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1265/2539] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:43.577884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:43.587772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef550bc-03d3-4155-b695-7e5a4b61d418 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:43.593148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:43.593817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:43.594102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:43.594407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:43.595113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:43.597092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:43.629232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1275/2540] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:37:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:37:43.633180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:43.647088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec037fd-4695-4165-a8b1-4810a72967a2 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:43.715961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:43.717244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:43.717532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:43.717903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:43.718493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:43.720604 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:43.732896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:43.750017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1266/2541] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:37:43 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:37:43.754000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:43.770944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bb348-2556-4a3f-8f79-4bdc5c53e1c7 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:43.775924 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:43.776644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:43.776910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:43.777194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:43.777934 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:43.779576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:43.791479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1276/2542] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:37:43.795909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:43.806685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ff73-3bed-4c04-a564-bdfae3e92805 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:43.812371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:43.813433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:43.813722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:43.814000 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] PATH_INFO: `/v3/projects/714d45bebc41486786cfced585f92980/users/c7d69d5032c3459686dbd3f5807c87d7/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:43.835059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714d45bebc41486786cfced585f92980, user_id=c7d69d5032c3459686dbd3f5807c87d7, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:43.838500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:43.856197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1267/2543] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:37:43 2022] PUT /identity/v3/projects/714d45bebc41486786cfced585f92980/users/c7d69d5032c3459686dbd3f5807c87d7/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:37:43.860089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:43.873686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf97276-d3b7-4f77-b601-7226fa8fc319 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:43.929827 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:43.963814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3bb73-cad7-433a-84ca-27c13db5be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:43.963814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3bb73-cad7-433a-84ca-27c13db5be8a admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:43.963814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3bb73-cad7-433a-84ca-27c13db5be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:43.963814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3bb73-cad7-433a-84ca-27c13db5be8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:43.964356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3bb73-cad7-433a-84ca-27c13db5be8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:43.964356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3bb73-cad7-433a-84ca-27c13db5be8a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:43.977774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1277/2544] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:37:43.981882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:43.992799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91201b-4b1b-4105-8484-28b5d3232336 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:43.998791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:43.999850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:44.000209 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:44.000558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] PATH_INFO: `/v3/projects/714d45bebc41486786cfced585f92980/users/c7d69d5032c3459686dbd3f5807c87d7/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:44.002716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714d45bebc41486786cfced585f92980, user_id=c7d69d5032c3459686dbd3f5807c87d7, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:44.005446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:44.022494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1268/2545] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:37:43 2022] PUT /identity/v3/projects/714d45bebc41486786cfced585f92980/users/c7d69d5032c3459686dbd3f5807c87d7/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:37:49.134083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514500-b2d5-4c76-b150-f4e479ad094f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:49.134890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514500-b2d5-4c76-b150-f4e479ad094f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:49.134890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514500-b2d5-4c76-b150-f4e479ad094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:49.171849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-92514500-b2d5-4c76-b150-f4e479ad094f None None] MFA Rules not processed for user `c7d69d5032c3459686dbd3f5807c87d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:49.173281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-92514500-b2d5-4c76-b150-f4e479ad094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:49.265566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1278/2546] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:49.280181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:37:49.281954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:49.361733 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9dd6c-4220-437c-9f44-5ce764d188b0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:37:49.367301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95bc2e-7565-4021-8093-c7baf2c1d011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:37:49.368193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95bc2e-7565-4021-8093-c7baf2c1d011 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:49.368480 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95bc2e-7565-4021-8093-c7baf2c1d011 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:49.368758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95bc2e-7565-4021-8093-c7baf2c1d011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:49.437346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95bc2e-7565-4021-8093-c7baf2c1d011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:37:49.439040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95bc2e-7565-4021-8093-c7baf2c1d011 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:37:49.451637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1269/2547] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:37:50.570900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:50.571979 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:50.572292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:50.591390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] MFA Rules not processed for user `0991de3fb3ee4410953b8984cf16d2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:50.592791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:50.599931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1279/2548] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:37:57.498323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:37:57.498904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:37:57.498904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:37:57.517678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] MFA Rules not processed for user `4df5c2b1e22f4c54b05eb77d9ba9818b`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:37:57.518907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:37:57.573651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:57.587311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1270/2549] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:37:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:38:00.585788 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=48 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:06.109735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:06.111165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:06.169051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178c381-a761-433a-9d42-c7fa5038d4e6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:06.172669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:06.173315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:06.173598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:06.173872 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:06.175660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:06.189664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:06.191108 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:06.202025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1280/2550] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:07.579817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:08.605041 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:08.615178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a13b1-011f-4cf4-b0f1-831875f20968 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:08.619219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:08.619998 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:08.620356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:08.620703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:08.624170 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:08.642272 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:08.643968 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:08.658050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1271/2551] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:09.870120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:09.880225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b52f-7654-44d9-a23a-4fa385f4bd32 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:09.884388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:09.885044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:09.885389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:09.885610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:09.887498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:09.962689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:09.964184 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:09.975062 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1281/2552] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:13.765098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:13.767775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:13.783140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57a17e-64d5-4905-a063-4d2504ac40a5 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:13.787985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:13.788902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:13.789191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:13.789473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] PATH_INFO: `/v3/users/a3099b72043c41ce8daa9bf8457efde3` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:13.790830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3099b72043c41ce8daa9bf8457efde3)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:13.792728 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:13.850652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3099b72043c41ce8daa9bf8457efde3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:13.851408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3099b72043c41ce8daa9bf8457efde3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:13.861058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3099b72043c41ce8daa9bf8457efde3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:13.878354 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3099b72043c41ce8daa9bf8457efde3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:13.886357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-dec3000f-8152-40be-abb0-c30ae68040e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3099b72043c41ce8daa9bf8457efde3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:13.898719 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1272/2553] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:38:13 2022] DELETE /identity/v3/users/a3099b72043c41ce8daa9bf8457efde3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:38:14.088027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.099284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6303-5080-4da9-95ad-1d3a4757225b service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.161883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.162710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.162993 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.163273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] PATH_INFO: `/v3/projects/4837ab5df3a14b9a85336de11a337989` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.164513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4837ab5df3a14b9a85336de11a337989)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.166449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.207742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:14.216090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4837ab5df3a14b9a85336de11a337989', 'request_id': 'req-6770c740-330f-4b3e-8075-58e9462867f2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:14.224171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4837ab5df3a14b9a85336de11a337989', 'request_id': 'req-6770c740-330f-4b3e-8075-58e9462867f2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:14.233424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4837ab5df3a14b9a85336de11a337989', 'request_id': 'req-6770c740-330f-4b3e-8075-58e9462867f2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:14.251246 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] The token cache is being invalidate because project 4837ab5df3a14b9a85336de11a337989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:38:14.251831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:14.252792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6770c740-330f-4b3e-8075-58e9462867f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:38:14.254900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1282/2554] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:38:14 2022] DELETE /identity/v3/projects/4837ab5df3a14b9a85336de11a337989 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:38:14.260571 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.260799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.261200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.282525 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:38:14.284563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:14.355289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1273/2555] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:38:14.363431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.363767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.364058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.383018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:38:14.384537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:14.395706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1283/2556] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:38:14.399907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.410917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e7d2-e0f1-4c70-a661-ead5b1e2538d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.415890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.417301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.417301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.417691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.418572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:38:14.419456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.420769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.443676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1274/2557] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:38:14.446006 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.456391 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598dccf-da0b-47fd-8096-5e610c38e12f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.464347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.465032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.465905 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.466191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.466896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.468881 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.505760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1284/2558] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:38:14.510438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.523822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da4b5-b1ec-431a-a25b-72604d0c0c26 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.581172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:14.601115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.601845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.602125 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.602399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.603088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.605240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.633581 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1275/2559] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:38:14 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:38:14.638721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.649524 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09d59b-9ec6-4a60-9ee2-ac60c530cc4c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.655232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.656110 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.656569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.656894 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.657923 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.661329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.679828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1285/2560] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:38:14.681227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.694348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d59c5-447c-40f1-bda0-c033d1b8292f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.703681 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7b09f-db6b-4869-b1ec-38cd8d361023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.704741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b09f-db6b-4869-b1ec-38cd8d361023 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.705232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b09f-db6b-4869-b1ec-38cd8d361023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.706335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b09f-db6b-4869-b1ec-38cd8d361023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.707539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7b09f-db6b-4869-b1ec-38cd8d361023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.709561 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7b09f-db6b-4869-b1ec-38cd8d361023 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.727317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1276/2561] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:38:14.728565 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.741373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a06cd8-6dc2-49dd-ab08-d0edbe6c388f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:14.747925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:14.748846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.749129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.749805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] PATH_INFO: `/v3/projects/3cca2283f1394927a7aaaa534e265663/users/57b5f6716b1745b2b3a3d763cdcb4eca/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.784942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cca2283f1394927a7aaaa534e265663, user_id=57b5f6716b1745b2b3a3d763cdcb4eca, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:14.788212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:14.813057 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1286/2562] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:38:14 2022] PUT /identity/v3/projects/3cca2283f1394927a7aaaa534e265663/users/57b5f6716b1745b2b3a3d763cdcb4eca/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:38:14.814488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:14.814977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:14.815060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:14.835206 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:38:14.836738 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:14.911029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1277/2563] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:38:14.930803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:14.935050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:15.030292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18347-f407-4af1-974f-3656ec3920a6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:15.036806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daaba5-e48f-4eff-97aa-5ca65c1fe530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:15.037475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daaba5-e48f-4eff-97aa-5ca65c1fe530 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:15.037759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daaba5-e48f-4eff-97aa-5ca65c1fe530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:15.038033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daaba5-e48f-4eff-97aa-5ca65c1fe530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:15.051217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daaba5-e48f-4eff-97aa-5ca65c1fe530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:15.053058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daaba5-e48f-4eff-97aa-5ca65c1fe530 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:15.064653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1287/2564] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:17.568823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:17.580326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447b596-6d4b-462a-87aa-bdc6ad951e2c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:17.586533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:17.588044 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:17.588796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:17.589532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:17.595262 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:17.729683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:17.732737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:17.745559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1278/2565] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:19.896384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a08c90-1fe0-4575-a48b-26e8a12d2aa0 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:19.896829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a08c90-1fe0-4575-a48b-26e8a12d2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:19.896932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a08c90-1fe0-4575-a48b-26e8a12d2aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:19.935178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-64a08c90-1fe0-4575-a48b-26e8a12d2aa0 None None] MFA Rules not processed for user `57b5f6716b1745b2b3a3d763cdcb4eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:38:19.936328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-64a08c90-1fe0-4575-a48b-26e8a12d2aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:20.006322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:20.022243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1288/2566] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:38:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:38:20.044638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:20.046228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:20.149615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:20.173742 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c247-39e6-4339-93f4-438c2c23e7b8 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:20.179903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:20.180601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:20.181033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:20.181324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:20.196203 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:20.202558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:20.225724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1279/2567] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:22.084478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:22.085016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:22.085315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:22.106810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] MFA Rules not processed for user `57b5f6716b1745b2b3a3d763cdcb4eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:38:22.108150 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:22.116310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1289/2568] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:38:22.885787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:22.888729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:22.975448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03925f0-b118-495a-b1fd-1cbdcab54d84 service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:22.980941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:22.981654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:22.981936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:22.982214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:22.984100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:22.997142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:22.998769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:23.010141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1280/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:24.992067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:24.993804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:25.006715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc9aac-e550-417c-b7fe-162c7b5f4137 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:25.010680 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:25.011352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:25.012319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:25.012804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:25.014625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:25.025167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:25.026638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:25.035572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1290/2570] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:38:33.005086 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=39 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:34.629299 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:34.630891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:34.647546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d73e7-cfe1-4fcf-8c60-00738ba1352e service placement] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:34.654185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:34.654837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:34.655119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:34.655396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:34.657305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:34.669964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:34.671577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:34.682868 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1281/2571] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:38:35.031572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=11 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:44.677902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=6 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:38:52.205229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:38:52.222977 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827599c-30ee-45a7-9e35-3dee2a9bc193 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:38:52.228442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:38:52.230944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:38:52.230944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:38:52.230944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:38:52.234920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:38:52.297573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:38:52.299225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:38:52.308575 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1291/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:02.304132 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=28 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:04.692275 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:04.702280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d238e1-2f7f-42ab-8be4-a75b34bccc6f service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:04.705829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:04.706464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:04.706749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:04.707028 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:04.708817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:04.721289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:04.722720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:04.732329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1282/2573] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:07.673944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:07.675544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:07.698748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00ce8-be48-46ae-a645-5f6448cc839c service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:07.703302 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:07.704340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:07.704622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:07.704898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] PATH_INFO: `/v3/users/4df5c2b1e22f4c54b05eb77d9ba9818b` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:07.706093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df5c2b1e22f4c54b05eb77d9ba9818b)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:07.708221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:07.766946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df5c2b1e22f4c54b05eb77d9ba9818b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:07.767518 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df5c2b1e22f4c54b05eb77d9ba9818b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:07.776554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df5c2b1e22f4c54b05eb77d9ba9818b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:07.788866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df5c2b1e22f4c54b05eb77d9ba9818b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:07.789582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4b7c7f77-45ee-447a-9694-60b68b3f9172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df5c2b1e22f4c54b05eb77d9ba9818b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:07.801858 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1292/2574] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:07 2022] DELETE /identity/v3/users/4df5c2b1e22f4c54b05eb77d9ba9818b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:07.981639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:07.991818 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38beb45-772a-47b0-89d8-d1938274f815 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.051671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.052463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.052753 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.053036 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] PATH_INFO: `/v3/projects/18d0a2572b3e4ac09422ff4a4f831277` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.054248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d0a2572b3e4ac09422ff4a4f831277)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.056244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.105336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d0a2572b3e4ac09422ff4a4f831277', 'request_id': 'req-9e34db66-3ad7-4487-bac0-8afdddfc4f91'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:08.110975 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d0a2572b3e4ac09422ff4a4f831277', 'request_id': 'req-9e34db66-3ad7-4487-bac0-8afdddfc4f91'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:08.117310 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d0a2572b3e4ac09422ff4a4f831277', 'request_id': 'req-9e34db66-3ad7-4487-bac0-8afdddfc4f91'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:08.131139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] The token cache is being invalidate because project 18d0a2572b3e4ac09422ff4a4f831277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:08.131368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:08.132900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-9e34db66-3ad7-4487-bac0-8afdddfc4f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:08.133829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1283/2575] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:07 2022] DELETE /identity/v3/projects/18d0a2572b3e4ac09422ff4a4f831277 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:08.139429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.139774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.140086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.158098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:08.159331 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:08.219909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1293/2576] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:08.231337 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.231645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.231960 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.252953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:08.254161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:08.262503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1284/2577] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:08.266936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.276723 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eea6a-ca76-44d4-9d4a-715d23c149e2 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.281374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.282050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.282330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.282603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.283328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:39:08.283649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.285260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.297505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1294/2578] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:39:08.301905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.311762 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd01d4-e83b-4a02-987a-87dc352b0358 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.316547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.317201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.317491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.317768 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.318456 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.320415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.347268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1285/2579] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:08.351321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.361711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1385-4adc-48f1-85e8-65d5f6f4ef84 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.419344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.420065 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.420353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.420633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.421324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.423269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.430027 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:08.446477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1295/2580] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:08.451031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.461440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923520-dbd1-4a42-ad6d-06c3d6b44c78 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.466184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.466863 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.467152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.467434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.468218 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.469852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.481508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1286/2581] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:08.485658 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.496367 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9e7f-bac2-4e63-81c1-c55d8054e5be admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.501097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f8a5-0f7b-4f87-a8a5-b187defc0838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.501756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f8a5-0f7b-4f87-a8a5-b187defc0838 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.502039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f8a5-0f7b-4f87-a8a5-b187defc0838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.502315 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f8a5-0f7b-4f87-a8a5-b187defc0838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.503041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f8a5-0f7b-4f87-a8a5-b187defc0838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.504681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f8a5-0f7b-4f87-a8a5-b187defc0838 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.515026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1296/2582] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:08.519166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.529606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5b6b-6763-4314-aeb1-a0badf4b7f31 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.534463 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.535343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.535641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.535928 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] PATH_INFO: `/v3/projects/5b79ebdaffb84d37bb4bc0e8225ce3a5/users/8b3cf524cac14215bef6116683752632/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.551276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b79ebdaffb84d37bb4bc0e8225ce3a5, user_id=8b3cf524cac14215bef6116683752632, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.554017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.567769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1287/2583] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:08 2022] PUT /identity/v3/projects/5b79ebdaffb84d37bb4bc0e8225ce3a5/users/8b3cf524cac14215bef6116683752632/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:08.577904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.578181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.578462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.606226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] MFA Rules not processed for user `8b3cf524cac14215bef6116683752632`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:08.607443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:08.674660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1297/2584] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:08.679656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.693375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:08.749198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfdf57-f4f2-4ebd-a317-9b649f611e5f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.754185 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.754883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.755192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.755479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.756240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.758517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.798264 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1288/2585] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:08.799449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.811112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ebd2-b67e-481c-b3c5-3698d6dc4eaf None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.874192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.874883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.875170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.875450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.876211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.878197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.900356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1298/2586] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:08 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:08.905416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.915932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653ad6-cfb5-4fe5-b584-27d8e23b573b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.920745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.921422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.921711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.921995 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.922725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.924384 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.935638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1289/2587] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:08.939863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:08.950584 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2870e9-0e32-46cc-bd5f-e873403e3012 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:08.955252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:08.956165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:08.956452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:08.956730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] PATH_INFO: `/v3/projects/5a26ea65e35f408f9ca0b6ee01358732/users/61d7c0e942a045149141a9aa6a62145f/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:08.972119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a26ea65e35f408f9ca0b6ee01358732, user_id=61d7c0e942a045149141a9aa6a62145f, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:08.974815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:08.987735 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1299/2588] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:08 2022] PUT /identity/v3/projects/5a26ea65e35f408f9ca0b6ee01358732/users/61d7c0e942a045149141a9aa6a62145f/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:08.991690 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:09.002388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da135-314d-49ab-a0f0-3df52f6468d7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:09.059648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc7e4-9f5b-4d30-8e84-df53be27d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:09.060317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc7e4-9f5b-4d30-8e84-df53be27d76a admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:09.060608 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc7e4-9f5b-4d30-8e84-df53be27d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:09.060897 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc7e4-9f5b-4d30-8e84-df53be27d76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:09.061679 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc7e4-9f5b-4d30-8e84-df53be27d76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:09.063280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc7e4-9f5b-4d30-8e84-df53be27d76a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:09.074478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1290/2589] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:09.078975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:09.089906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ea8aa-7aae-44e8-89bd-a2c07b99ea84 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:09.094574 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:09.095453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:09.095801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:09.096077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] PATH_INFO: `/v3/projects/5a26ea65e35f408f9ca0b6ee01358732/users/61d7c0e942a045149141a9aa6a62145f/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:09.098041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a26ea65e35f408f9ca0b6ee01358732, user_id=61d7c0e942a045149141a9aa6a62145f, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:09.100767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:09.110914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1300/2590] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:09 2022] PUT /identity/v3/projects/5a26ea65e35f408f9ca0b6ee01358732/users/61d7c0e942a045149141a9aa6a62145f/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:09.122278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:09.122569 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:09.122855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:09.151194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] MFA Rules not processed for user `61d7c0e942a045149141a9aa6a62145f`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:09.152434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:09.219796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1291/2591] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:09.231058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:09.232814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:09.258077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:09.295863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90a073-c969-4998-850e-433ac879b7d4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:09.299659 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ad11-9ac5-4203-8a6d-62511473727e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:09.300314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ad11-9ac5-4203-8a6d-62511473727e service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:09.300599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ad11-9ac5-4203-8a6d-62511473727e service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:09.300878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ad11-9ac5-4203-8a6d-62511473727e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:09.310426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ad11-9ac5-4203-8a6d-62511473727e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:09.311962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ad11-9ac5-4203-8a6d-62511473727e service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:09.321357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1301/2592] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:09.393363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:09.403196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a69f-dc16-430d-a16f-eda902f4061d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:09.406830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:09.407472 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:09.407791 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:09.408072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:09.413315 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:09.471127 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:09.472623 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:09.482178 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1292/2593] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:39:19.317225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=17 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:19.478057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=24 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:30.071678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:30.072148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:30.072243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:30.092298 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:30.093517 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:30.149289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1302/2594] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:39:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:30.197331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:30.199242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:30.283900 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc5095-5927-4746-be42-8df87f69d8a5 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:30.291792 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:30.292693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:30.293134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:30.293563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:30.324252 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:30.325072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:30.334988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1293/2595] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:39:33.251791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:33.253903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:33.398316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef569-b0a6-4af6-b609-ee0fe7d182be None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:33.405138 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:33.405959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:33.406921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:33.407195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:33.412222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:33.432021 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:33.434594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3059df-ad8c-4397-8215-0a8a8958c8a3 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:33.460903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1303/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:39.433589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:39.500271 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd0179-688a-4c6c-8186-168f9d257dc4 service swift] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:39.504943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:39.505811 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:39.506099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:39.506379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] PATH_INFO: `/v3/users/8b3cf524cac14215bef6116683752632` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:39.507856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3cf524cac14215bef6116683752632)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:39.509796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:39.557140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3cf524cac14215bef6116683752632'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:39.557798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3cf524cac14215bef6116683752632'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:39.566468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3cf524cac14215bef6116683752632'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:39.578737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3cf524cac14215bef6116683752632'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:39.585553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3cf524cac14215bef6116683752632'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:39.592101 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1294/2597] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:39 2022] DELETE /identity/v3/users/8b3cf524cac14215bef6116683752632 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:39.596631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:39.597122 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:39.597220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:39.620530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:39.621774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:39.682896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1304/2598] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:39.692595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:39.694017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:39.705446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:39.754024 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4fda-a37c-4f54-999d-f3e72d4afd22 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:39.757941 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:39.758589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:39.758873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:39.759149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:39.769031 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:39.770478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:39.780886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1295/2599] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:40.069789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:40.071793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:40.090440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8785-143e-4dc9-bd09-086b108c2542 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:40.096301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:40.097345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:40.097698 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:40.098050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] PATH_INFO: `/v3/projects/5b79ebdaffb84d37bb4bc0e8225ce3a5` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:40.099553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b79ebdaffb84d37bb4bc0e8225ce3a5)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:40.103508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:40.137903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:40.156835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b79ebdaffb84d37bb4bc0e8225ce3a5', 'request_id': 'req-ee29baa8-9ca8-4d1b-ad23-afab7368be21'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.162950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b79ebdaffb84d37bb4bc0e8225ce3a5', 'request_id': 'req-ee29baa8-9ca8-4d1b-ad23-afab7368be21'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.173602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b79ebdaffb84d37bb4bc0e8225ce3a5', 'request_id': 'req-ee29baa8-9ca8-4d1b-ad23-afab7368be21'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.192330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] The token cache is being invalidate because project 5b79ebdaffb84d37bb4bc0e8225ce3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:40.192776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.193463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.195482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1305/2600] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:40 2022] DELETE /identity/v3/projects/5b79ebdaffb84d37bb4bc0e8225ce3a5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:40.201474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:40.210896 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0b8c6-24ec-467e-a21b-6973b2f72263 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:40.270981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:40.271904 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:40.272187 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:40.272465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] PATH_INFO: `/v3/users/61d7c0e942a045149141a9aa6a62145f` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:40.273703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d7c0e942a045149141a9aa6a62145f)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:40.275692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:40.328305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d7c0e942a045149141a9aa6a62145f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.329029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d7c0e942a045149141a9aa6a62145f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.337050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d7c0e942a045149141a9aa6a62145f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.349580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d7c0e942a045149141a9aa6a62145f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.361327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-c4ccc5da-86f8-4e58-870f-0c65c82a7aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d7c0e942a045149141a9aa6a62145f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.368485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1296/2601] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:40 2022] DELETE /identity/v3/users/61d7c0e942a045149141a9aa6a62145f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:40.677214 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:40.678835 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:40.695311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29baa8-9ca8-4d1b-ad23-afab7368be21 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:40.756208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:40.757352 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:40.757635 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:40.757931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] PATH_INFO: `/v3/projects/5a26ea65e35f408f9ca0b6ee01358732` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:40.759144 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a26ea65e35f408f9ca0b6ee01358732)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:40.761197 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:40.809196 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a26ea65e35f408f9ca0b6ee01358732', 'request_id': 'req-8ef7eee3-26c2-4501-8da6-adefcb614651'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.814437 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a26ea65e35f408f9ca0b6ee01358732', 'request_id': 'req-8ef7eee3-26c2-4501-8da6-adefcb614651'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.820576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a26ea65e35f408f9ca0b6ee01358732', 'request_id': 'req-8ef7eee3-26c2-4501-8da6-adefcb614651'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.834654 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] The token cache is being invalidate because project 5a26ea65e35f408f9ca0b6ee01358732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:40.835053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.835730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-8ef7eee3-26c2-4501-8da6-adefcb614651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:40.837390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1306/2602] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:40 2022] DELETE /identity/v3/projects/5a26ea65e35f408f9ca0b6ee01358732 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:40.843192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:40.843732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:40.843835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:40.862246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:40.863451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:40.892842 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:40.939335 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1297/2603] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:40.947204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28853-1175-408a-9b86-a369c232a14c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:40.947500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28853-1175-408a-9b86-a369c232a14c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:40.947818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28853-1175-408a-9b86-a369c232a14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:40.966907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-57d28853-1175-408a-9b86-a369c232a14c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:40.968148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-57d28853-1175-408a-9b86-a369c232a14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:40.976432 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1307/2604] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:40.981318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:40.991544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66ba5c-138c-4d4a-a624-a3c83255a792 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:40.996208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:40.996871 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:40.997153 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:40.997431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:40.998160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:39:40.998470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.000128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.012308 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1298/2605] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:39:41.016621 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d28853-1175-408a-9b86-a369c232a14c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.026353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d28853-1175-408a-9b86-a369c232a14c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.031209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.031908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.032185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.032457 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.033147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.035090 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.071078 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1308/2606] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:41 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:41.075280 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.085407 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851d28-87e6-405f-848f-a4eda5b1c1b0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.143933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.144609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.144898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.145176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.145877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.147879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.168669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1299/2607] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:41 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:41.172862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.183162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35604-59b6-4527-8a17-51a05701c77b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.188529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.189226 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.189508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.189782 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.190547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.192268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.193699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:41.204264 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1309/2608] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:41.208305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.218905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3eec-a997-472b-834f-b48056603179 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.223531 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74431dd6-2028-44a7-87f3-5407ad6b1c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.224221 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74431dd6-2028-44a7-87f3-5407ad6b1c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.224511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74431dd6-2028-44a7-87f3-5407ad6b1c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.224794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74431dd6-2028-44a7-87f3-5407ad6b1c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.225523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74431dd6-2028-44a7-87f3-5407ad6b1c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.227137 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74431dd6-2028-44a7-87f3-5407ad6b1c5b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.237301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1300/2609] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:41.241898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.252054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add745-fa13-463c-a8e2-21d9cfeb25a4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.256674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.257806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.258086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.258360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] PATH_INFO: `/v3/projects/deea478b38e941e7a0afce4ec4332b29/users/3358ccabb8ab45b9b8d75e61eec635d4/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.273778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deea478b38e941e7a0afce4ec4332b29, user_id=3358ccabb8ab45b9b8d75e61eec635d4, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.277153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.290137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1310/2610] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:41 2022] PUT /identity/v3/projects/deea478b38e941e7a0afce4ec4332b29/users/3358ccabb8ab45b9b8d75e61eec635d4/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:41.301150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.301466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.301875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.329408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] MFA Rules not processed for user `3358ccabb8ab45b9b8d75e61eec635d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:41.330541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:41.398589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1301/2611] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:41.403666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.467405 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165e109-1e49-4319-a2eb-b4bf1ceeea67 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.471733 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.472411 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.472685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.472957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.473676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.475579 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.501278 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1311/2612] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:41 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:41.508596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.519500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62d96-6d60-4ead-b7fe-446bc5724356 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.543908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:41.579201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.579996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.580234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.580721 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.581231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.583202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.604754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1302/2613] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:41 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:41.608975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.620707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea43ec-7eba-4d6f-b711-376056bfec25 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.625546 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.626216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.626491 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.626766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.627492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.629158 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.642937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1312/2614] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:41.647317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.657431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104954ff-b839-41f0-8e8d-98e8c03ca663 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.662213 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.663130 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.663414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.663723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] PATH_INFO: `/v3/projects/ea58f49649124bdeae7c63a1fdb05a75/users/b76a959c43614462b0c78200b0b32a97/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.679108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea58f49649124bdeae7c63a1fdb05a75, user_id=b76a959c43614462b0c78200b0b32a97, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.682364 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.696258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1303/2615] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:41 2022] PUT /identity/v3/projects/ea58f49649124bdeae7c63a1fdb05a75/users/b76a959c43614462b0c78200b0b32a97/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:41.700933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.711679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5cdc4-5d77-4868-ab1e-7b1d262a21db admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.768433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b345fd8-2787-46f1-949d-13ec5d075233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.769096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b345fd8-2787-46f1-949d-13ec5d075233 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.769377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b345fd8-2787-46f1-949d-13ec5d075233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.769652 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b345fd8-2787-46f1-949d-13ec5d075233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.770373 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b345fd8-2787-46f1-949d-13ec5d075233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.772001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b345fd8-2787-46f1-949d-13ec5d075233 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.781768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1313/2616] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:41.786060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.796303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e8ea-37c3-451b-8df2-2342b51d5563 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:41.800883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:41.801761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.802047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.802328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] PATH_INFO: `/v3/projects/ea58f49649124bdeae7c63a1fdb05a75/users/b76a959c43614462b0c78200b0b32a97/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.804322 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea58f49649124bdeae7c63a1fdb05a75, user_id=b76a959c43614462b0c78200b0b32a97, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:41.807481 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:41.817585 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1304/2617] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:41 2022] PUT /identity/v3/projects/ea58f49649124bdeae7c63a1fdb05a75/users/b76a959c43614462b0c78200b0b32a97/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:41.828136 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:41.828428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:41.828710 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:41.855294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] MFA Rules not processed for user `b76a959c43614462b0c78200b0b32a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:41.856460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:41.886856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:41.926613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1314/2618] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:41.938434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:41.940225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:41.996938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805f0d-bb92-412c-96a8-d8d8f631c8ad admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:42.000692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0794e-91e8-4749-9910-19efe329c98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:42.001332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0794e-91e8-4749-9910-19efe329c98b service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:42.001616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0794e-91e8-4749-9910-19efe329c98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:42.001894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0794e-91e8-4749-9910-19efe329c98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:42.011266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0794e-91e8-4749-9910-19efe329c98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:42.012730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0794e-91e8-4749-9910-19efe329c98b service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:42.022026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1305/2619] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:42.430548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:42.498790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a5605-1664-47b8-9ac4-93d1980bfeed None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:42.504887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:42.505814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:42.506121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:42.506362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] PATH_INFO: `/v3/users/3358ccabb8ab45b9b8d75e61eec635d4` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:42.508104 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3358ccabb8ab45b9b8d75e61eec635d4)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:42.510052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:42.561630 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3358ccabb8ab45b9b8d75e61eec635d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:42.562427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3358ccabb8ab45b9b8d75e61eec635d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:42.570809 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3358ccabb8ab45b9b8d75e61eec635d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:42.582878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3358ccabb8ab45b9b8d75e61eec635d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:42.583589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3358ccabb8ab45b9b8d75e61eec635d4'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:42.601347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1315/2620] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:42 2022] DELETE /identity/v3/users/3358ccabb8ab45b9b8d75e61eec635d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:42.606381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:42.607612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:42.607612 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:42.626643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:42.628068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:42.691100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1306/2621] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:42.701510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:42.702994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:42.758985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:42.766389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5335a-b04f-4fa9-985b-caf3e2092760 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:42.771559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:42.772252 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:42.772534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:42.772810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:42.782940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:42.784537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:42.794909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1316/2622] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:43.084141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:43.085880 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.107068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa59b5-e207-4956-b92d-41a212b1040c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:43.112985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:43.113989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.114339 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.114685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] PATH_INFO: `/v3/projects/deea478b38e941e7a0afce4ec4332b29` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.115903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deea478b38e941e7a0afce4ec4332b29)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:43.118890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:43.138009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:43.138882 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:43.146443 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c88f1c-93f2-4a2b-bf48-54d76bdde15f service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:43.150381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:43.151068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.151354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.151649 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.153513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.163799 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:43.165902 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:43.175800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1317/2623] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:39:43.179495 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deea478b38e941e7a0afce4ec4332b29', 'request_id': 'req-5f744473-5519-4d67-aa0b-2ebc7658c1d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.186428 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deea478b38e941e7a0afce4ec4332b29', 'request_id': 'req-5f744473-5519-4d67-aa0b-2ebc7658c1d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.193147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deea478b38e941e7a0afce4ec4332b29', 'request_id': 'req-5f744473-5519-4d67-aa0b-2ebc7658c1d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.208838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] The token cache is being invalidate because project deea478b38e941e7a0afce4ec4332b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:43.209126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.209764 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-5f744473-5519-4d67-aa0b-2ebc7658c1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.211662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1307/2624] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:43 2022] DELETE /identity/v3/projects/deea478b38e941e7a0afce4ec4332b29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:43.216077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:43.230647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b806-20a1-4cb1-8183-8dbd66102477 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:43.313386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75353b1-2285-4392-b5f2-0812f163e83a None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.313711 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75353b1-2285-4392-b5f2-0812f163e83a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.314020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75353b1-2285-4392-b5f2-0812f163e83a None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.315669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1308/2625] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:39:43.322025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20121-1f50-484d-a916-9192edaa040a None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.322427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20121-1f50-484d-a916-9192edaa040a None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.323214 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20121-1f50-484d-a916-9192edaa040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.330893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:43.331986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.334778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.335179 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] PATH_INFO: `/v3/users/b76a959c43614462b0c78200b0b32a97` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.336653 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76a959c43614462b0c78200b0b32a97)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:43.339134 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:43.365314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-1ca20121-1f50-484d-a916-9192edaa040a None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:43.366559 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-1ca20121-1f50-484d-a916-9192edaa040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.401147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76a959c43614462b0c78200b0b32a97'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.401846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76a959c43614462b0c78200b0b32a97'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.410997 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76a959c43614462b0c78200b0b32a97'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.428703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76a959c43614462b0c78200b0b32a97'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.429539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76a959c43614462b0c78200b0b32a97'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.444783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1318/2626] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:43 2022] DELETE /identity/v3/users/b76a959c43614462b0c78200b0b32a97 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:43.453394 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1309/2627] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:43.466831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:43.468400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.532663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc0450-6876-4006-ad0b-e06153f73e22 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:43.536357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff52cf-ab89-4cae-b16b-4008702214db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:43.537019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff52cf-ab89-4cae-b16b-4008702214db service glance] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.537281 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff52cf-ab89-4cae-b16b-4008702214db service glance] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.537556 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff52cf-ab89-4cae-b16b-4008702214db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.547463 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:43.619120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff52cf-ab89-4cae-b16b-4008702214db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:43.621167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff52cf-ab89-4cae-b16b-4008702214db service glance] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:43.632383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1319/2628] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:43.701482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0babfc-0dbf-471b-80ce-d9e077efadd4 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.701783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0babfc-0dbf-471b-80ce-d9e077efadd4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.702141 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0babfc-0dbf-471b-80ce-d9e077efadd4 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.703546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1310/2629] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 16:39:43.708921 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.709489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.709489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.722254 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0babfc-0dbf-471b-80ce-d9e077efadd4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:43.724311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9f0babfc-0dbf-471b-80ce-d9e077efadd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.731498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] MFA Rules not processed for user `6ae2e3c1b1b04ce7950a81c33308d560`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:43.732734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.789553 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1320/2630] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:43.799969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0babfc-0dbf-471b-80ce-d9e077efadd4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:43.801691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:43.803037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.805963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:43.806883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.807167 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.807442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] PATH_INFO: `/v3/projects/ea58f49649124bdeae7c63a1fdb05a75` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.808666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea58f49649124bdeae7c63a1fdb05a75)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:43.810568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:43.813729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426d26-9661-4c46-afe3-d8f24557ddce None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:43.817474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452ca00-9ce0-4d22-8210-858b82136d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:43.818123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ca00-9ce0-4d22-8210-858b82136d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.818399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ca00-9ce0-4d22-8210-858b82136d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.818677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ca00-9ce0-4d22-8210-858b82136d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.825992 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452ca00-9ce0-4d22-8210-858b82136d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:43.827453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452ca00-9ce0-4d22-8210-858b82136d65 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:43.835258 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1321/2631] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:39:43.846309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:43.865899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea58f49649124bdeae7c63a1fdb05a75', 'request_id': 'req-e3c700de-676a-4013-9962-1fff275b3b03'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.871831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea58f49649124bdeae7c63a1fdb05a75', 'request_id': 'req-e3c700de-676a-4013-9962-1fff275b3b03'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.878689 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea58f49649124bdeae7c63a1fdb05a75', 'request_id': 'req-e3c700de-676a-4013-9962-1fff275b3b03'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.893111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] The token cache is being invalidate because project ea58f49649124bdeae7c63a1fdb05a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:43.893486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.894248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3c700de-676a-4013-9962-1fff275b3b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:43.896210 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1311/2632] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:43 2022] DELETE /identity/v3/projects/ea58f49649124bdeae7c63a1fdb05a75 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:43.901510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db46a-e6ec-471b-86c4-295e31e784b2 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.901803 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db46a-e6ec-471b-86c4-295e31e784b2 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.902086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db46a-e6ec-471b-86c4-295e31e784b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.923361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-236db46a-e6ec-471b-86c4-295e31e784b2 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:43.924660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-236db46a-e6ec-471b-86c4-295e31e784b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.940078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2643-5404-49db-bdab-5c0782dd5f87 None None] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.940465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2643-5404-49db-bdab-5c0782dd5f87 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.940747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2643-5404-49db-bdab-5c0782dd5f87 None None] PATH_INFO: `/` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.942151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1312/2633] 10.222.0.25 () {54 vars in 921 bytes} [Thu May 19 16:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 16:39:43.947485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.947828 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.948115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:43.966825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] MFA Rules not processed for user `87dd16048e5244f4adc3f5859d6ea8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:43.968072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:43.986706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1322/2634] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:43.994976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592607-e9db-4011-9c72-16964bbb131d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:43.995269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592607-e9db-4011-9c72-16964bbb131d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:43.995548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592607-e9db-4011-9c72-16964bbb131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.014361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-82592607-e9db-4011-9c72-16964bbb131d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:44.015569 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-82592607-e9db-4011-9c72-16964bbb131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:44.023823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1323/2635] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:44.028743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592607-e9db-4011-9c72-16964bbb131d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.037582 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1313/2636] 10.222.0.25 () {58 vars in 1018 bytes} [Thu May 19 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:44.038081 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592607-e9db-4011-9c72-16964bbb131d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.043341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.044053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.044335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.044611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.045335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:39:44.045640 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.047243 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.048991 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.050913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:44.063119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1324/2637] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:39:44.064076 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.074182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec055b-2c1f-40e8-821e-de05997a3a9f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.079003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.079685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.079972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.080255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.080937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.082845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.093839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:44.110966 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1325/2638] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:44 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:44.112747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df240be-75ab-4eb8-beb3-e300d3113d5c None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.114662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.166242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.166798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.167087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.167368 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.177545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c047b-db99-4415-81bb-9fb616fc4b46 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.180522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:44.182549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.183215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.183493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.183796 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.184475 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.186406 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.207235 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1326/2639] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:44 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:44.211319 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.222328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1d47a-2d25-439f-abd4-5b2355d61017 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.229146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.229146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.229146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.229146 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.229963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.231088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.241844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.242779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1327/2640] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:39:44.244122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.246750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.256250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1314/2641] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:39:44.257922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569fa8-882f-4897-a372-03557dc12b1a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.263305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cef77-d18d-440b-8c92-ad3a1fdf97f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.264089 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cef77-d18d-440b-8c92-ad3a1fdf97f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.264533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cef77-d18d-440b-8c92-ad3a1fdf97f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.264929 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cef77-d18d-440b-8c92-ad3a1fdf97f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.265756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cef77-d18d-440b-8c92-ad3a1fdf97f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.267449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cef77-d18d-440b-8c92-ad3a1fdf97f0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.279311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1328/2642] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:39:44.283541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.294059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0c61-3116-43ba-9939-52e80299f50f service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.298800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.299797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.300151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.300439 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] PATH_INFO: `/v3/projects/268f15611f4840e8b86c44824696c0ef/users/1966ac746a144a39aa9f705cc2ddf429/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.315782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=268f15611f4840e8b86c44824696c0ef, user_id=1966ac746a144a39aa9f705cc2ddf429, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.318602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.333158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1315/2643] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:44 2022] PUT /identity/v3/projects/268f15611f4840e8b86c44824696c0ef/users/1966ac746a144a39aa9f705cc2ddf429/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:44.344804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.345099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.345380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.372973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] MFA Rules not processed for user `1966ac746a144a39aa9f705cc2ddf429`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:44.374318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:44.441287 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1329/2644] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:44.445647 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.520096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de5643-f63a-41cf-b752-dbf5acfbe923 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.526801 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.527731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.528113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.528491 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.529313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.531356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.562156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1316/2645] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:44 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:44.566183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.578516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dabe09-f183-45a1-b1fe-e9c90c114756 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.630629 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:44.651810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.651810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.651810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.651810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.652939 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.655211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.676660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1330/2646] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:44 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:44.680911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.692219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2c43-d9f5-496d-9ed6-d5f973359879 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.697179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.698519 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.698794 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.699072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.699906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.701528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.715684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1317/2647] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:39:44.718379 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.729423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ab01-93be-42ce-bac9-c976e224b690 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.734441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.735327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.735644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.735918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] PATH_INFO: `/v3/projects/3a09e6bd585544dbbf949f2d59f9c594/users/18b504bd5dbe4630a12998f2966e2986/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.753068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a09e6bd585544dbbf949f2d59f9c594, user_id=18b504bd5dbe4630a12998f2966e2986, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.755793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.770292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1331/2648] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:44 2022] PUT /identity/v3/projects/3a09e6bd585544dbbf949f2d59f9c594/users/18b504bd5dbe4630a12998f2966e2986/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:44.774397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.785898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92ce9b-b857-407e-9791-915e0525f6a6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.836274 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:44.846781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518840-0464-4dea-bf13-8eab475dfe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.847454 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518840-0464-4dea-bf13-8eab475dfe04 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.847807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518840-0464-4dea-bf13-8eab475dfe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.848245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518840-0464-4dea-bf13-8eab475dfe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.848983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518840-0464-4dea-bf13-8eab475dfe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.850674 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518840-0464-4dea-bf13-8eab475dfe04 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.861532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1318/2649] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:44.865801 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:44.877023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279efd-7651-4238-8c7c-687050ba5685 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:44.882205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:44.883098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.883385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.883711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] PATH_INFO: `/v3/projects/3a09e6bd585544dbbf949f2d59f9c594/users/18b504bd5dbe4630a12998f2966e2986/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.885741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a09e6bd585544dbbf949f2d59f9c594, user_id=18b504bd5dbe4630a12998f2966e2986, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:44.888510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:44.905354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1332/2650] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:44 2022] PUT /identity/v3/projects/3a09e6bd585544dbbf949f2d59f9c594/users/18b504bd5dbe4630a12998f2966e2986/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:44.922015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:44.922355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:44.922732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:44.949798 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] MFA Rules not processed for user `18b504bd5dbe4630a12998f2966e2986`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:44.950936 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:45.027990 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1319/2651] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:45.037686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:45.039607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:45.101147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3f8b-65e9-4de7-b409-03b54f7a93fa admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:45.105376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4edd2-51a8-46a4-ba7e-f4b5c86077b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:45.106037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4edd2-51a8-46a4-ba7e-f4b5c86077b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:45.106327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4edd2-51a8-46a4-ba7e-f4b5c86077b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:45.106602 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4edd2-51a8-46a4-ba7e-f4b5c86077b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:45.116330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4edd2-51a8-46a4-ba7e-f4b5c86077b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:45.117864 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4edd2-51a8-46a4-ba7e-f4b5c86077b6 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:45.128427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1333/2652] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:45.157378 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:45.222225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231c27d-617d-46fb-8f8e-39721320aad1 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:45.227062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:45.228018 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:45.228347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:45.229357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] PATH_INFO: `/v3/users/1966ac746a144a39aa9f705cc2ddf429` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:45.230758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1966ac746a144a39aa9f705cc2ddf429)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:45.232744 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:45.279238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1966ac746a144a39aa9f705cc2ddf429'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:45.279940 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1966ac746a144a39aa9f705cc2ddf429'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:45.287437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1966ac746a144a39aa9f705cc2ddf429'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:45.304356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1966ac746a144a39aa9f705cc2ddf429'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:45.309577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:45.312434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1966ac746a144a39aa9f705cc2ddf429'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:45.319763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1320/2653] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:45 2022] DELETE /identity/v3/users/1966ac746a144a39aa9f705cc2ddf429 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:45.324293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:45.324587 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:45.324869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:45.343120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:45.344480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:45.404377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1334/2654] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:45.413925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:45.415333 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:45.475138 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29787-dd33-4668-bdad-59b6d4d23763 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:45.478789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:45.479453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:45.479805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:45.480610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:45.490142 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:45.491592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:45.502298 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1321/2655] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:45.958875 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:45.960381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:45.978765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a42db7-6f6c-4a48-9b6b-ccfb0dcacd74 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:45.984685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:45.985449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:45.985781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:45.986180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] PATH_INFO: `/v3/projects/268f15611f4840e8b86c44824696c0ef` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:45.987381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] RBAC: Authorizing `identity:delete_project(project_id=268f15611f4840e8b86c44824696c0ef)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:45.989426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:46.033761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:46.041942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268f15611f4840e8b86c44824696c0ef', 'request_id': 'req-a11c5dda-3d24-487e-bd67-1c1a66cc885b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.047972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268f15611f4840e8b86c44824696c0ef', 'request_id': 'req-a11c5dda-3d24-487e-bd67-1c1a66cc885b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.054718 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268f15611f4840e8b86c44824696c0ef', 'request_id': 'req-a11c5dda-3d24-487e-bd67-1c1a66cc885b'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.067975 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] The token cache is being invalidate because project 268f15611f4840e8b86c44824696c0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:46.068266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.068976 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.070629 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1335/2656] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:45 2022] DELETE /identity/v3/projects/268f15611f4840e8b86c44824696c0ef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:46.076727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:46.087019 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa220ed-2353-4d74-88af-368818967115 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:46.147906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:46.148787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:46.149216 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:46.149392 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] PATH_INFO: `/v3/users/18b504bd5dbe4630a12998f2966e2986` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:46.150593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b504bd5dbe4630a12998f2966e2986)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:46.152602 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:46.221427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b504bd5dbe4630a12998f2966e2986'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.222099 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b504bd5dbe4630a12998f2966e2986'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.229891 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b504bd5dbe4630a12998f2966e2986'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.243289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b504bd5dbe4630a12998f2966e2986'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.251078 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-6d143183-d83a-4b76-877c-8442e27425df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b504bd5dbe4630a12998f2966e2986'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.257613 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1322/2657] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:46 2022] DELETE /identity/v3/users/18b504bd5dbe4630a12998f2966e2986 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:46.695669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:46.697121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:46.709994 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5dda-3d24-487e-bd67-1c1a66cc885b admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:46.782185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:46.783067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:46.783348 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:46.783650 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] PATH_INFO: `/v3/projects/3a09e6bd585544dbbf949f2d59f9c594` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:46.784991 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a09e6bd585544dbbf949f2d59f9c594)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:46.786505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:46.786755 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:46.786862 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:46.787091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:46.805065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:46.806311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:46.816543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:46.837610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a09e6bd585544dbbf949f2d59f9c594', 'request_id': 'req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.843828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a09e6bd585544dbbf949f2d59f9c594', 'request_id': 'req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.850365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a09e6bd585544dbbf949f2d59f9c594', 'request_id': 'req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.864209 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] The token cache is being invalidate because project 3a09e6bd585544dbbf949f2d59f9c594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:46.864505 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.865130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-be4dd49b-c4e7-4ac2-a1aa-ed9cc9c3469e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:46.866686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1336/2658] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:46 2022] DELETE /identity/v3/projects/3a09e6bd585544dbbf949f2d59f9c594 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:46.868172 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1323/2659] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:46.871516 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa9a1-31dc-4557-bd03-8415e08a42e1 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:46.871937 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa9a1-31dc-4557-bd03-8415e08a42e1 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:46.872109 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa9a1-31dc-4557-bd03-8415e08a42e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:46.880713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:46.882424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:46.897598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b53fa9a1-31dc-4557-bd03-8415e08a42e1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:46.898531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b53fa9a1-31dc-4557-bd03-8415e08a42e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:46.952083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:46.953242 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac479e-d9a9-48b4-b67e-dfc0b41ab8a7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:46.963591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1337/2660] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:46.972068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:46.972767 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:46.973055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:46.991780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:46.992984 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:47.001248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1338/2661] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:47.005781 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.015134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.015330 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64741-4c74-4d15-a0ec-75bbd6c38e49 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.015861 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.016093 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.016370 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.018148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:47.019978 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.020623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.021034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.021321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.022049 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:39:47.022361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.024018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.036353 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1339/2662] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:39:47.040614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.050814 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134e565-973a-460a-a9aa-8df001f638ca admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.055744 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.056381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.056665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.056944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.057627 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.059534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.080081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.081779 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.090329 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1340/2663] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:47 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:47.091446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1324/2664] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 16:39:47.091643 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.160454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26df5-6d12-453f-95cf-db6525bcd181 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.166736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.167562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.167910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.168461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.169628 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.172423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.228943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1341/2665] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:47 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:47.230383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.239927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:47.249803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04ac7-424f-49dd-aa1a-3a5c4f79e89c service swift] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.266269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.267874 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.268176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.269309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.271106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.275488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.310013 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1325/2666] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:47.311496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.329378 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bd13f-b91d-48eb-9be7-f450a4427bb4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.343273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451eb21-0b37-42f4-9e93-0b9ee51fb80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.344001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451eb21-0b37-42f4-9e93-0b9ee51fb80b admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.344289 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451eb21-0b37-42f4-9e93-0b9ee51fb80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.344854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451eb21-0b37-42f4-9e93-0b9ee51fb80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.345789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451eb21-0b37-42f4-9e93-0b9ee51fb80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.347441 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451eb21-0b37-42f4-9e93-0b9ee51fb80b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.363354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1342/2667] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:47.366501 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.381492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ece87-a873-4dce-b71b-cba5140ce7a8 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.388338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.389398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.389691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.389973 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] PATH_INFO: `/v3/projects/3315cab8c6cb45e9ad8faf8af5058252/users/0f5455b6e11a405d8f2ca842d58ce1fb/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.415434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3315cab8c6cb45e9ad8faf8af5058252, user_id=0f5455b6e11a405d8f2ca842d58ce1fb, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.419824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.456390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1326/2668] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:47 2022] PUT /identity/v3/projects/3315cab8c6cb45e9ad8faf8af5058252/users/0f5455b6e11a405d8f2ca842d58ce1fb/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:47.458403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.458768 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.459646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.500487 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] MFA Rules not processed for user `0f5455b6e11a405d8f2ca842d58ce1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:47.502160 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:47.595773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1343/2669] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:47.597888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.682545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117259d-4848-4098-85e0-01c02efc5665 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.688740 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.689318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.689318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.689942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.690294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.692269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.732724 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1327/2670] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:47 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:47.736590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.757434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fd29f-f7d5-4c33-8692-e6de917d59fb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.779192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:47.824126 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.825022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.825436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.825779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.826708 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.829205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.852297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1344/2671] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:47 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:47.856700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.868334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d5bc-ef75-43b2-862b-a5712e1c47b5 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.874956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.875833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.876323 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.876666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.877479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.879192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.896500 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1328/2672] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:39:47.898255 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.908679 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f440cf-c461-4b02-a693-c8fad32d064e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.913922 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885fed-ff41-4060-9793-da1fc18fbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.914879 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885fed-ff41-4060-9793-da1fc18fbce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.915174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885fed-ff41-4060-9793-da1fc18fbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.915500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885fed-ff41-4060-9793-da1fc18fbce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.916338 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885fed-ff41-4060-9793-da1fc18fbce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.919151 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885fed-ff41-4060-9793-da1fc18fbce4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.930700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1345/2673] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:47.935267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:47.947460 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9892f6-e4c8-4197-b1b2-437647cc2f94 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:47.952648 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:47.953546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:47.953836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:47.954114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] PATH_INFO: `/v3/projects/4670b4ceae9a4ff6acececf1ab45873b/users/a5ac9ade84c94995a890f51e34a72e41/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:47.970123 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4670b4ceae9a4ff6acececf1ab45873b, user_id=a5ac9ade84c94995a890f51e34a72e41, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:47.973413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:47.989329 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1329/2674] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:47 2022] PUT /identity/v3/projects/4670b4ceae9a4ff6acececf1ab45873b/users/a5ac9ade84c94995a890f51e34a72e41/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:48.000086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.000740 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.001001 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.030414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] MFA Rules not processed for user `a5ac9ade84c94995a890f51e34a72e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:48.031543 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:48.099257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1346/2675] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:48.104015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.172592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcd84-aa65-47e6-bcd0-b839885ae0c9 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.177573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.178243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.178528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.178807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.179660 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.181603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.218985 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1330/2676] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:48 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:48.220418 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.234086 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a29a-c9be-4f66-9470-b860e9b3971c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.306377 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.306973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.307256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.307534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.308314 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.310270 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.334360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1347/2677] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:48 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:48.335544 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.343075 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:48.346969 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8dd4-ad5f-444d-a84d-aca2fbb79c4a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.353211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.354386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.355516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.356111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.357238 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.359266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.370852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1331/2678] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:48.375227 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.385815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dd20-4c86-4c7a-86ef-c104aa75802a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.390980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.392032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.392567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.392948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] PATH_INFO: `/v3/projects/5d9bc329d3264090a24d575d32382a67/users/eaad1be2bc4445aa99272714d29cab09/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.409965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9bc329d3264090a24d575d32382a67, user_id=eaad1be2bc4445aa99272714d29cab09, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.412891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.423837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:48.431267 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1348/2679] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:48 2022] PUT /identity/v3/projects/5d9bc329d3264090a24d575d32382a67/users/eaad1be2bc4445aa99272714d29cab09/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:48.436435 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.447989 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c860f-21b5-4a91-8eb0-4506b77a53ba admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.516397 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20271b8-96c2-4228-9726-94db6f1abcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.517338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20271b8-96c2-4228-9726-94db6f1abcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.517817 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20271b8-96c2-4228-9726-94db6f1abcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.518173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20271b8-96c2-4228-9726-94db6f1abcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.519121 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20271b8-96c2-4228-9726-94db6f1abcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.521482 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20271b8-96c2-4228-9726-94db6f1abcc7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.534385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1332/2680] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:39:48.538599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.551216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e7add-b907-4756-9d4c-e89a9b71cba4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.556274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.557230 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.557461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.557774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] PATH_INFO: `/v3/projects/5d9bc329d3264090a24d575d32382a67/users/eaad1be2bc4445aa99272714d29cab09/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.560121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9bc329d3264090a24d575d32382a67, user_id=eaad1be2bc4445aa99272714d29cab09, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.562878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.590676 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1349/2681] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:48 2022] PUT /identity/v3/projects/5d9bc329d3264090a24d575d32382a67/users/eaad1be2bc4445aa99272714d29cab09/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:48.601615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.602147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.602470 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.653128 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] MFA Rules not processed for user `eaad1be2bc4445aa99272714d29cab09`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:48.654553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:48.751211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1333/2682] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:39:48.769448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.771521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:48.835765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c129c-e08a-4fa8-845a-58adac97f24f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.840486 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.841148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.841429 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.841707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.853073 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.854779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:48.865335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1350/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:48.910426 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:48.914676 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:48.924580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda64b-a1bd-44fe-824b-af9797634cc4 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:48.928557 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3aa35-f89d-4c00-a8fb-e0d69c2193a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:48.929215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3aa35-f89d-4c00-a8fb-e0d69c2193a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:48.929502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3aa35-f89d-4c00-a8fb-e0d69c2193a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:48.929783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3aa35-f89d-4c00-a8fb-e0d69c2193a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:48.996324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3aa35-f89d-4c00-a8fb-e0d69c2193a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:48.997819 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3aa35-f89d-4c00-a8fb-e0d69c2193a0 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:49.007586 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1334/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:39:52.019779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:52.096623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f627c1-4ed4-4f77-bfb6-3bb07aac837d service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:52.101316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:52.102201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:52.102488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:52.102770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] PATH_INFO: `/v3/users/0f5455b6e11a405d8f2ca842d58ce1fb` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:52.104030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5455b6e11a405d8f2ca842d58ce1fb)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:52.106018 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:52.159297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5455b6e11a405d8f2ca842d58ce1fb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.159990 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5455b6e11a405d8f2ca842d58ce1fb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.168526 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5455b6e11a405d8f2ca842d58ce1fb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.190002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5455b6e11a405d8f2ca842d58ce1fb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.191100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5455b6e11a405d8f2ca842d58ce1fb'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.226063 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1351/2685] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:52 2022] DELETE /identity/v3/users/0f5455b6e11a405d8f2ca842d58ce1fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:52.231754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:52.232353 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:52.232620 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:52.251182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:52.252618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:52.262584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=100 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:52.333667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1335/2686] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:52.346249 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:52.347980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:52.361478 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:52.445502 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b42bf-092d-4962-8244-dd9feef95c17 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:52.449438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:52.450250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:52.450542 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:52.450822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:52.460686 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:52.462147 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:52.471758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1352/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:39:52.774193 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:52.775732 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:52.814053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9f6d9-f36b-4c1b-9e1d-96ce4acfb0ed None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:52.819808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:52.821056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:52.821558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:52.822211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] PATH_INFO: `/v3/projects/3315cab8c6cb45e9ad8faf8af5058252` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:52.823514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3315cab8c6cb45e9ad8faf8af5058252)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:52.825556 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:52.882134 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3315cab8c6cb45e9ad8faf8af5058252', 'request_id': 'req-ea883e51-6b47-44ad-b595-941e28ae309f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.889692 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3315cab8c6cb45e9ad8faf8af5058252', 'request_id': 'req-ea883e51-6b47-44ad-b595-941e28ae309f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.901987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3315cab8c6cb45e9ad8faf8af5058252', 'request_id': 'req-ea883e51-6b47-44ad-b595-941e28ae309f'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.916770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] The token cache is being invalidate because project 3315cab8c6cb45e9ad8faf8af5058252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:52.917240 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.917972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:52.920002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1336/2688] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:52 2022] DELETE /identity/v3/projects/3315cab8c6cb45e9ad8faf8af5058252 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:52.924120 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:52.937121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255d9ee-7dec-41e2-aa6a-9f94bb27c67f service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:53.000101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:53.000919 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:53.001294 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:53.001632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] PATH_INFO: `/v3/users/a5ac9ade84c94995a890f51e34a72e41` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:53.002927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ac9ade84c94995a890f51e34a72e41)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:53.004995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:53.064296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ac9ade84c94995a890f51e34a72e41'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.065489 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ac9ade84c94995a890f51e34a72e41'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.073946 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ac9ade84c94995a890f51e34a72e41'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.087293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ac9ade84c94995a890f51e34a72e41'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.088085 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ac9ade84c94995a890f51e34a72e41'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.101954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1353/2689] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:52 2022] DELETE /identity/v3/users/a5ac9ade84c94995a890f51e34a72e41 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:39:53.413839 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:53.415330 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:53.430331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea883e51-6b47-44ad-b595-941e28ae309f admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:53.509934 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:53.510996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:53.511386 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:53.511776 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] PATH_INFO: `/v3/projects/4670b4ceae9a4ff6acececf1ab45873b` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:53.513106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4670b4ceae9a4ff6acececf1ab45873b)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:53.515453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:53.585577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:53.610259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4670b4ceae9a4ff6acececf1ab45873b', 'request_id': 'req-d77e17e1-acf3-4911-96ba-f48c28fbe40d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.628181 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4670b4ceae9a4ff6acececf1ab45873b', 'request_id': 'req-d77e17e1-acf3-4911-96ba-f48c28fbe40d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.648233 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4670b4ceae9a4ff6acececf1ab45873b', 'request_id': 'req-d77e17e1-acf3-4911-96ba-f48c28fbe40d'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.676668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] The token cache is being invalidate because project 4670b4ceae9a4ff6acececf1ab45873b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:53.677046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.677627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.679662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1337/2690] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:53 2022] DELETE /identity/v3/projects/4670b4ceae9a4ff6acececf1ab45873b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:53.685739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:53.687885 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:53.706079 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341afd3f-a7e9-490e-b950-e29f0f3cf4ee admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:53.748987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:53.787460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:53.788343 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:53.788688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:53.788907 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] PATH_INFO: `/v3/users/eaad1be2bc4445aa99272714d29cab09` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:53.790253 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaad1be2bc4445aa99272714d29cab09)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:53.792328 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:53.846874 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaad1be2bc4445aa99272714d29cab09'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.847877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaad1be2bc4445aa99272714d29cab09'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.861174 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaad1be2bc4445aa99272714d29cab09'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.874225 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaad1be2bc4445aa99272714d29cab09'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.874909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3ac409e3-1fbb-4130-8d5e-42a929e35b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaad1be2bc4445aa99272714d29cab09'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:53.889562 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1354/2691] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:39:53 2022] DELETE /identity/v3/users/eaad1be2bc4445aa99272714d29cab09 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:54.233091 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.234619 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:54.256927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e17e1-acf3-4911-96ba-f48c28fbe40d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.342546 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.343594 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.343979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.344340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] PATH_INFO: `/v3/projects/5d9bc329d3264090a24d575d32382a67` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.345638 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9bc329d3264090a24d575d32382a67)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.347987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.400622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9bc329d3264090a24d575d32382a67', 'request_id': 'req-46ca36a9-b8e2-45bd-b940-53553ef4f20e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:54.411684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9bc329d3264090a24d575d32382a67', 'request_id': 'req-46ca36a9-b8e2-45bd-b940-53553ef4f20e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:54.420474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9bc329d3264090a24d575d32382a67', 'request_id': 'req-46ca36a9-b8e2-45bd-b940-53553ef4f20e'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:54.435414 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] The token cache is being invalidate because project 5d9bc329d3264090a24d575d32382a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:39:54.435746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:54.436380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-46ca36a9-b8e2-45bd-b940-53553ef4f20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:39:54.438073 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1338/2692] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:39:54 2022] DELETE /identity/v3/projects/5d9bc329d3264090a24d575d32382a67 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:54.444022 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.444527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.444633 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.466237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:54.467454 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:54.556376 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1355/2693] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:54.564954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.565245 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.565527 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.585854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:54.587304 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:54.600244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1339/2694] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:54.601763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.615424 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896180-0aa5-4442-bf77-1ac5d9d58fdd None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.621215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.621883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.622162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.622435 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.623166 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:39:54.623472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.625221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.639660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1356/2695] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:39:54.643964 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.655504 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a141f0-47c6-4518-bf7e-9b6177e5e634 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.660727 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.661444 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.661921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.662199 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.662903 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.665055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.697162 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1340/2696] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:54 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:54.701523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.713387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c6e2f-2d86-4f32-9a23-f9412c5327d1 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.757450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:54.794410 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.795690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.796220 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.796849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.797820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.800232 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.824742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1357/2697] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:54 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:54.828997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.847824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce29d1b-4da4-426a-a858-765c7462a7bd admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.853341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.854017 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.855009 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.855316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.856072 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.857716 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.868875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1341/2698] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:54.874041 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.885465 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dc34f-eb74-47a3-b874-04fa805a72db admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.891802 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6d3d-06fb-416b-8132-5c2fb0cec30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.892479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6d3d-06fb-416b-8132-5c2fb0cec30b admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.892763 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6d3d-06fb-416b-8132-5c2fb0cec30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.893035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6d3d-06fb-416b-8132-5c2fb0cec30b admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.893805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e6d3d-06fb-416b-8132-5c2fb0cec30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.895499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e6d3d-06fb-416b-8132-5c2fb0cec30b admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.906096 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1358/2699] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:54.910258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:54.921358 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fd1b-3989-4eb9-81a1-6282f9a640ce admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:54.926224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:54.927166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.927457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.927870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] PATH_INFO: `/v3/projects/47bfdb9b6251492ab9bfe713be87f2a4/users/377dc2801b5b4561824425d1c28f5ecc/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:54.943829 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bfdb9b6251492ab9bfe713be87f2a4, user_id=377dc2801b5b4561824425d1c28f5ecc, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:54.946622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:54.948908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:54.962118 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1342/2700] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:54 2022] PUT /identity/v3/projects/47bfdb9b6251492ab9bfe713be87f2a4/users/377dc2801b5b4561824425d1c28f5ecc/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:54.974212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:54.974523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:54.974824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.010178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] MFA Rules not processed for user `377dc2801b5b4561824425d1c28f5ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:55.011392 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:55.076031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1359/2701] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:55.080591 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.142047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24d0b-21d9-4421-9325-39cb60c29d0b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.146593 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.147249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.147651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.147948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.148627 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.150517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.175987 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1343/2702] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:39:55 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:39:55.180098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.190951 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43ba9-c32b-4173-872d-3b814fa7941a None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.246675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.247333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.247636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.247914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.248593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.250501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.270346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1360/2703] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:39:55 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:39:55.274649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.285510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4567-60b3-4b2c-8f4b-d64f88d45206 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.290324 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.290980 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.291268 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.291554 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.293154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.294895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.305831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1344/2704] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:55.310124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.320157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180fec8-7ab4-49e8-adf0-84f5e8c6335a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.325845 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.326745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.327033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.327316 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] PATH_INFO: `/v3/projects/3572154580b34682ad552456a1810fda/users/29e8ea16413840a293912ded9525e79a/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.344778 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3572154580b34682ad552456a1810fda, user_id=29e8ea16413840a293912ded9525e79a, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.347481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.361854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1361/2705] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:55 2022] PUT /identity/v3/projects/3572154580b34682ad552456a1810fda/users/29e8ea16413840a293912ded9525e79a/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:55.365925 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.376118 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6dbf6-95c3-429c-b4ac-d4fe48fadeb2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.433152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7824-d6eb-4e34-b422-3d15b89453f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.433879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7824-d6eb-4e34-b422-3d15b89453f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.434097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7824-d6eb-4e34-b422-3d15b89453f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.434381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7824-d6eb-4e34-b422-3d15b89453f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.435104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7824-d6eb-4e34-b422-3d15b89453f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.436749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7824-d6eb-4e34-b422-3d15b89453f0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.446524 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1345/2706] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:39:55.451217 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.461547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c1a4-5c4a-4b41-b2a4-1ee2e975b0a1 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.466754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.467647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.467963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.468240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] PATH_INFO: `/v3/projects/3572154580b34682ad552456a1810fda/users/29e8ea16413840a293912ded9525e79a/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.470344 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3572154580b34682ad552456a1810fda, user_id=29e8ea16413840a293912ded9525e79a, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.473102 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.476567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:55.484906 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1362/2707] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:39:55 2022] PUT /identity/v3/projects/3572154580b34682ad552456a1810fda/users/29e8ea16413840a293912ded9525e79a/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:39:55.495830 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.496131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.496419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.524196 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] MFA Rules not processed for user `29e8ea16413840a293912ded9525e79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:39:55.525457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:55.576135 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:39:55.595697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1346/2708] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:39:55.607093 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.608861 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:39:55.666890 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117060a1-84d7-4cee-895a-149d394cc268 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.670530 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.671172 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.671456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.671776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.680590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.682056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.692045 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1363/2709] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:39:55.774751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:39:55.784381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6afbde-ea36-4938-8fee-db2bdbc19cb9 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:39:55.788001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713b255-c327-47ad-8941-ce4cf1925819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:39:55.788634 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713b255-c327-47ad-8941-ce4cf1925819 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:39:55.788920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713b255-c327-47ad-8941-ce4cf1925819 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:39:55.789200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713b255-c327-47ad-8941-ce4cf1925819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:39:55.845550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713b255-c327-47ad-8941-ce4cf1925819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:39:55.846996 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713b255-c327-47ad-8941-ce4cf1925819 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:39:55.855905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1347/2710] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:39:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:00.555586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:00.617528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ef6d6-5d24-48fc-a29a-a714eabe3bc4 service cinder] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:00.622682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:00.623545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:00.623863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:00.624145 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] PATH_INFO: `/v3/users/377dc2801b5b4561824425d1c28f5ecc` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:00.625333 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=377dc2801b5b4561824425d1c28f5ecc)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:00.627269 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:00.673715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377dc2801b5b4561824425d1c28f5ecc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:00.674288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377dc2801b5b4561824425d1c28f5ecc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:00.681606 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377dc2801b5b4561824425d1c28f5ecc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:00.693896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377dc2801b5b4561824425d1c28f5ecc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:00.694515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377dc2801b5b4561824425d1c28f5ecc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:00.706972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1364/2711] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:40:00 2022] DELETE /identity/v3/users/377dc2801b5b4561824425d1c28f5ecc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:00.711530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:00.712110 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:00.712251 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:00.729800 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:00.731011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:00.788849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1348/2712] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:40:00.799599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:00.801275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:00.826070 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:00.866657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3a5c-52f3-4743-809c-062880a324cf admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:00.870988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:00.871684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:00.871970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:00.872247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:00.882173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:00.883734 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:00.894877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1365/2713] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:01.189034 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:01.190338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:01.202729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dd725-31b8-4970-9e3e-b97a55c438ad None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:01.207926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:01.209913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:01.210208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:01.210575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] PATH_INFO: `/v3/projects/47bfdb9b6251492ab9bfe713be87f2a4` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:01.211835 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bfdb9b6251492ab9bfe713be87f2a4)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:01.214844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:01.267825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bfdb9b6251492ab9bfe713be87f2a4', 'request_id': 'req-22dbd2a6-098b-419d-b968-93929b61f253'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.273509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bfdb9b6251492ab9bfe713be87f2a4', 'request_id': 'req-22dbd2a6-098b-419d-b968-93929b61f253'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.280434 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bfdb9b6251492ab9bfe713be87f2a4', 'request_id': 'req-22dbd2a6-098b-419d-b968-93929b61f253'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.294104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] The token cache is being invalidate because project 47bfdb9b6251492ab9bfe713be87f2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:40:01.294589 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.295229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.296836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1349/2714] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:40:01 2022] DELETE /identity/v3/projects/47bfdb9b6251492ab9bfe713be87f2a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:01.300880 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:01.311035 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b439f81-824a-4151-aacf-c7e24a526956 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:01.373420 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:01.374442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:01.374793 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:01.375043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] PATH_INFO: `/v3/users/29e8ea16413840a293912ded9525e79a` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:01.376519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e8ea16413840a293912ded9525e79a)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:01.378577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:01.440233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e8ea16413840a293912ded9525e79a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.440940 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e8ea16413840a293912ded9525e79a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.449593 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e8ea16413840a293912ded9525e79a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.463043 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e8ea16413840a293912ded9525e79a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.464364 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ef3d2164-da9e-4069-8af2-15edf8b07ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e8ea16413840a293912ded9525e79a'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.476673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1366/2715] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:40:01 2022] DELETE /identity/v3/users/29e8ea16413840a293912ded9525e79a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:01.761894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:01.763471 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:01.777126 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd2a6-098b-419d-b968-93929b61f253 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:01.785789 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:01.845959 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:01.846879 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:01.847164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:01.847441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] PATH_INFO: `/v3/projects/3572154580b34682ad552456a1810fda` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:01.848783 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3572154580b34682ad552456a1810fda)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:01.850864 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:01.899068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3572154580b34682ad552456a1810fda', 'request_id': 'req-43ee9d27-0dd8-44c5-99a5-aa6313d63348'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.905082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3572154580b34682ad552456a1810fda', 'request_id': 'req-43ee9d27-0dd8-44c5-99a5-aa6313d63348'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.911643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3572154580b34682ad552456a1810fda', 'request_id': 'req-43ee9d27-0dd8-44c5-99a5-aa6313d63348'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.927754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] The token cache is being invalidate because project 3572154580b34682ad552456a1810fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:40:01.928070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.928775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-43ee9d27-0dd8-44c5-99a5-aa6313d63348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:01.930396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1350/2716] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:40:01 2022] DELETE /identity/v3/projects/3572154580b34682ad552456a1810fda => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:01.936044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:01.936632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:01.936632 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:01.954775 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:01.955949 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:01.989114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:02.017823 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1367/2717] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:02.025614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.025906 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.026186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.044459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:02.045685 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:02.054212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1351/2718] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:02.059113 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.069152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bf74f-5ed8-43a2-ab9e-338db3230d05 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.074400 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.075059 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.075372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.075687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.076425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:40:02.076742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.078387 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.091660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1368/2719] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:40:02.095436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.105490 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5c9e-6327-4c29-830a-3f2e2eb9cc5e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.110415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.111157 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.111514 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.111961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.112722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.114751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.145607 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1352/2720] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:40:02 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:40:02.146699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.156863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b131f0-7520-450c-88a2-8bbc53b3eb19 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.214296 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.214891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.215173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.215452 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.216189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.218133 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.238168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1369/2721] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:40:02 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:40:02.242459 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.253119 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825154f-a692-4244-84e4-8fb515aea0a1 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.258197 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.258849 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.259132 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.259406 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.260164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.261755 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.272065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1353/2722] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:40:02.275936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.285893 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06964cf-b9c1-4c29-9407-d689fe4d99e9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.290460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec9a7-edb9-4a7d-8097-6747daf1984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.291131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec9a7-edb9-4a7d-8097-6747daf1984a admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.291397 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec9a7-edb9-4a7d-8097-6747daf1984a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.292222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec9a7-edb9-4a7d-8097-6747daf1984a admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.292973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec9a7-edb9-4a7d-8097-6747daf1984a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.294588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec9a7-edb9-4a7d-8097-6747daf1984a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.304552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1370/2723] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:40:02.309415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.319523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e551f8-28ff-4564-a6b9-bd330e848bd9 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.324190 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.325087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.325377 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.325699 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] PATH_INFO: `/v3/projects/299883c3842047f7a425c2143c1ab8fd/users/8a65e95504e64637a156248483c0374e/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.340683 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=299883c3842047f7a425c2143c1ab8fd, user_id=8a65e95504e64637a156248483c0374e, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.343321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.356194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1354/2724] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:40:02 2022] PUT /identity/v3/projects/299883c3842047f7a425c2143c1ab8fd/users/8a65e95504e64637a156248483c0374e/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:02.361271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d573eda-ce0e-4b2d-b1c8-cd7ba7c14231 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.361566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d573eda-ce0e-4b2d-b1c8-cd7ba7c14231 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.361849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d573eda-ce0e-4b2d-b1c8-cd7ba7c14231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.380157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-7d573eda-ce0e-4b2d-b1c8-cd7ba7c14231 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:02.381604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7d573eda-ce0e-4b2d-b1c8-cd7ba7c14231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:02.439780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1371/2725] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:02.449381 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:02.451080 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:02.492945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:02.511509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e22c0-10c5-411e-96ff-851ccf283dcc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:02.515202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:02.515890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.516179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.516462 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.525611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:02.527568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:02.536993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1355/2726] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:02.923477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b8326-efab-4308-9739-172fbbc91358 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:02.924365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b8326-efab-4308-9739-172fbbc91358 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:02.924917 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b8326-efab-4308-9739-172fbbc91358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:02.944340 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-948b8326-efab-4308-9739-172fbbc91358 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:02.945620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-948b8326-efab-4308-9739-172fbbc91358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:02.991895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:03.008573 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1372/2727] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 19 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:03.021651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.024097 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:03.099641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097f38a-73e0-488f-8403-d240ce1ee3ef service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.105523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.106200 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.106485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.106770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.115865 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.117572 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.126431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1356/2728] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:40:03.183003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.183404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.183846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.213598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] MFA Rules not processed for user `8a65e95504e64637a156248483c0374e`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:03.214908 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:03.305641 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1373/2729] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:03.311451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.328474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fa5cd-6504-4ee6-b4ef-3b50b77df859 service swift] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.337004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.337752 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.338115 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.338499 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.339398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.342832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.388563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1357/2730] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:40:03 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:40:03.392519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.412008 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695469c9-c118-4670-b6d1-38b4c94af0cb None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.488498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.489178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.489512 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.489797 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.490499 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.492509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.517739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1374/2731] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:40:03 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:40:03.518873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.529596 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014c10-2edc-4e62-b426-ad8436da9379 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.534195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.534867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.535154 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.535432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.536208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.537832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.551994 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1358/2732] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:40:03.553127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.563884 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d25d30-7ef5-49d8-8672-9ab64cefff41 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.568605 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.569498 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.569780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.570056 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] PATH_INFO: `/v3/projects/dc933c4be2334f8b9cdf3d868ea2a0be/users/399e57e922394b48b4daec2aa46c6bf6/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.585972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc933c4be2334f8b9cdf3d868ea2a0be, user_id=399e57e922394b48b4daec2aa46c6bf6, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.588761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.602684 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1375/2733] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:40:03 2022] PUT /identity/v3/projects/dc933c4be2334f8b9cdf3d868ea2a0be/users/399e57e922394b48b4daec2aa46c6bf6/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:03.607498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.617778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6bd0-fbee-455f-a4d3-d03a124fac9c admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.677422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a78ea-99ed-4bf4-8c80-b39f94fecb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.678096 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a78ea-99ed-4bf4-8c80-b39f94fecb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.678390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a78ea-99ed-4bf4-8c80-b39f94fecb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.678671 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a78ea-99ed-4bf4-8c80-b39f94fecb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.679399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a78ea-99ed-4bf4-8c80-b39f94fecb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.681042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a78ea-99ed-4bf4-8c80-b39f94fecb83 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.694902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1359/2734] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:40:03.696163 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:03.707013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb71a2c-7f40-4e23-9132-a3398371089f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:03.712187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cffd47-290c-452a-9ca2-bbfa144d1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:03.713077 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffd47-290c-452a-9ca2-bbfa144d1289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:03.713358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffd47-290c-452a-9ca2-bbfa144d1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:03.713631 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffd47-290c-452a-9ca2-bbfa144d1289 admin admin] PATH_INFO: `/v3/projects/dc933c4be2334f8b9cdf3d868ea2a0be/users/399e57e922394b48b4daec2aa46c6bf6/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:03.715592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cffd47-290c-452a-9ca2-bbfa144d1289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc933c4be2334f8b9cdf3d868ea2a0be, user_id=399e57e922394b48b4daec2aa46c6bf6, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:03.718260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cffd47-290c-452a-9ca2-bbfa144d1289 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:03.728824 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1376/2735] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:40:03 2022] PUT /identity/v3/projects/dc933c4be2334f8b9cdf3d868ea2a0be/users/399e57e922394b48b4daec2aa46c6bf6/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:04.401164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:04.402277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:04.402277 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:04.432664 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] MFA Rules not processed for user `399e57e922394b48b4daec2aa46c6bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:04.433382 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:04.457523 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:04.544068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1360/2736] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:04.546953 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:04.547537 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:04.547666 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:04.567167 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] MFA Rules not processed for user `8a65e95504e64637a156248483c0374e`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:04.568711 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:04.605477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:04.638610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1377/2737] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:04.649843 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:04.651993 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:04.724152 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857c924-4695-4ac7-9d15-819e51ffceba None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:04.729793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:04.730442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:04.730760 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:04.731045 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:04.738823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:04.740449 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:04.749919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1361/2738] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:04.983013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:05.037205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bfbf-acf1-4118-93ca-d8a6eb086c58 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:05.040761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:05.041401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:05.041682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:05.041959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:05.043792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:05.053100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:05.054540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:05.062918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1378/2739] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:14.746052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=53 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:15.059492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=36 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:17.653945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:17.655416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:17.712933 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1f8da-3ce5-495c-9e89-36e2971cb3ff service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:17.716637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:17.717317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:17.717605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:17.717884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:17.726888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:17.728371 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:17.737766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1362/2740] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:27.733601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=26 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:37.258149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:37.324162 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54169-08c3-48db-9839-febb3686da5b service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:37.329165 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:37.330036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:37.330317 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:37.330592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] PATH_INFO: `/v3/users/8a65e95504e64637a156248483c0374e` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:37.331805 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a65e95504e64637a156248483c0374e)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:37.333750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:37.379596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a65e95504e64637a156248483c0374e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.380215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a65e95504e64637a156248483c0374e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.387859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a65e95504e64637a156248483c0374e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.400157 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a65e95504e64637a156248483c0374e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.400800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a65e95504e64637a156248483c0374e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.413053 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1379/2741] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:40:37 2022] DELETE /identity/v3/users/8a65e95504e64637a156248483c0374e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:37.595806 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:37.606734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862de60-9c1d-47b1-a20e-c6fa3ad7bb34 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:37.672042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:37.672913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:37.673348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:37.673651 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] PATH_INFO: `/v3/projects/299883c3842047f7a425c2143c1ab8fd` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:37.675095 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299883c3842047f7a425c2143c1ab8fd)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:37.677105 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:37.726139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299883c3842047f7a425c2143c1ab8fd', 'request_id': 'req-34c92dcf-ef44-48e5-8f28-e21b425ab812'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.732622 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299883c3842047f7a425c2143c1ab8fd', 'request_id': 'req-34c92dcf-ef44-48e5-8f28-e21b425ab812'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.739318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299883c3842047f7a425c2143c1ab8fd', 'request_id': 'req-34c92dcf-ef44-48e5-8f28-e21b425ab812'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.759351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] The token cache is being invalidate because project 299883c3842047f7a425c2143c1ab8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:40:37.759351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.759986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.761840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1363/2742] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:40:37 2022] DELETE /identity/v3/projects/299883c3842047f7a425c2143c1ab8fd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:37.765810 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:37.767601 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:37.786774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaafe2-e109-45e0-9c16-ff318e806c6a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:37.844590 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:37.845468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:37.845748 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:37.846024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] PATH_INFO: `/v3/users/399e57e922394b48b4daec2aa46c6bf6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:37.847216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] RBAC: Authorizing `identity:delete_user(user_id=399e57e922394b48b4daec2aa46c6bf6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:37.849173 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:37.870699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:37.896002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399e57e922394b48b4daec2aa46c6bf6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.896677 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399e57e922394b48b4daec2aa46c6bf6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.905268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399e57e922394b48b4daec2aa46c6bf6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.918153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399e57e922394b48b4daec2aa46c6bf6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.919479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-cd1971c6-184e-4aad-a840-2fc38d7e529e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399e57e922394b48b4daec2aa46c6bf6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:37.931980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1380/2743] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:40:37 2022] DELETE /identity/v3/users/399e57e922394b48b4daec2aa46c6bf6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:38.112734 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.115159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:38.127887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92dcf-ef44-48e5-8f28-e21b425ab812 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.190295 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.191387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.191691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.191972 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] PATH_INFO: `/v3/projects/dc933c4be2334f8b9cdf3d868ea2a0be` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.193192 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc933c4be2334f8b9cdf3d868ea2a0be)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.195139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.232326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:38.249641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc933c4be2334f8b9cdf3d868ea2a0be', 'request_id': 'req-78f50685-5978-4cc4-8adb-0e15a96b4690'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:38.256756 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc933c4be2334f8b9cdf3d868ea2a0be', 'request_id': 'req-78f50685-5978-4cc4-8adb-0e15a96b4690'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:38.263517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc933c4be2334f8b9cdf3d868ea2a0be', 'request_id': 'req-78f50685-5978-4cc4-8adb-0e15a96b4690'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:38.281536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] The token cache is being invalidate because project dc933c4be2334f8b9cdf3d868ea2a0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:40:38.281833 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:38.282505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-78f50685-5978-4cc4-8adb-0e15a96b4690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:38.284139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1364/2744] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:40:38 2022] DELETE /identity/v3/projects/dc933c4be2334f8b9cdf3d868ea2a0be => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:38.289124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.289599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.289703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.307508 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:38.308764 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:38.368932 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1381/2745] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:38.378413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.378707 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.378992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.397441 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:38.398564 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:38.406927 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1365/2746] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:38.411058 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.421182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c892-b724-4bf2-8e78-6154dd0790e7 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.425903 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.426564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.426849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.427128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.427965 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:40:38.428277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.429900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.441750 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1382/2747] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:40:38.446148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.455528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6880b-57c8-4eb9-83c6-9a6273e11d7f None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.460158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.461365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.461365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.461365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.462050 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.463988 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.491136 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1366/2748] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:40:38 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:40:38.496500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.506786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a0ca1-f88b-4ee6-873a-d0ceef7e7609 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.565284 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.565957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.566248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.566527 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.567221 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.569201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.589741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1383/2749] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:40:38 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:40:38.594505 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.607211 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1180a1-c461-4f8f-b560-0e8318b5078b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.614845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.615515 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.615919 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.616112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.616847 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.618465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.629383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1367/2750] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:40:38.633935 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.644613 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02342f94-d69c-4542-83d9-4129f2cf7440 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.649313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7b7b1-c38b-4b73-94b6-f002971e25b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.649914 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7b7b1-c38b-4b73-94b6-f002971e25b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.650201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7b7b1-c38b-4b73-94b6-f002971e25b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.650481 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7b7b1-c38b-4b73-94b6-f002971e25b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.651212 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7b7b1-c38b-4b73-94b6-f002971e25b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.653356 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7b7b1-c38b-4b73-94b6-f002971e25b1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.663736 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1384/2751] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:40:38.668174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.678876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecefae-0387-4462-b6d0-904b56457156 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.683475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.684405 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.684682 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.684954 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] PATH_INFO: `/v3/projects/b3cd4bf610ee4d138a7dcf904f68b5e2/users/6afee83cf7c14b889d14028dac34c24f/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.699344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cd4bf610ee4d138a7dcf904f68b5e2, user_id=6afee83cf7c14b889d14028dac34c24f, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.702042 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.714713 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1368/2752] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:40:38 2022] PUT /identity/v3/projects/b3cd4bf610ee4d138a7dcf904f68b5e2/users/6afee83cf7c14b889d14028dac34c24f/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:38.725280 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.725572 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.725854 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.733325 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:38.754358 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] MFA Rules not processed for user `6afee83cf7c14b889d14028dac34c24f`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:38.755840 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:38.819761 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1385/2753] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:38.831380 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:38.833232 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:38.903106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390b96-7edd-447a-93ee-c810c71fa79a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:38.907052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a634885-c718-400b-add7-c45e61c2fa1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:38.907893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a634885-c718-400b-add7-c45e61c2fa1c service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:38.908250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a634885-c718-400b-add7-c45e61c2fa1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:38.908528 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a634885-c718-400b-add7-c45e61c2fa1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:38.921379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a634885-c718-400b-add7-c45e61c2fa1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:38.923067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a634885-c718-400b-add7-c45e61c2fa1c service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:38.933151 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1369/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:43.915101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:43.980039 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcc363-eb8f-4045-b0f6-4946c3bd0792 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:43.985888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:43.986730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:43.987015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:43.987292 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] PATH_INFO: `/v3/users/6afee83cf7c14b889d14028dac34c24f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:43.988594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afee83cf7c14b889d14028dac34c24f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:43.990594 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:44.065101 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afee83cf7c14b889d14028dac34c24f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.066121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afee83cf7c14b889d14028dac34c24f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.076525 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afee83cf7c14b889d14028dac34c24f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.090128 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afee83cf7c14b889d14028dac34c24f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.090843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afee83cf7c14b889d14028dac34c24f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.103714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1386/2755] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:40:43 2022] DELETE /identity/v3/users/6afee83cf7c14b889d14028dac34c24f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:40:44.108766 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80ab4e-883c-4302-b15e-101a7169c2b1 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:44.109244 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80ab4e-883c-4302-b15e-101a7169c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:44.109362 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80ab4e-883c-4302-b15e-101a7169c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:44.127328 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-7b80ab4e-883c-4302-b15e-101a7169c2b1 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:44.128599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7b80ab4e-883c-4302-b15e-101a7169c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:44.182363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:44.197098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1370/2756] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:44.203933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:44.205365 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:44.220042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:44.270910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088f0e7-4586-4d7a-91a6-2f7ad89885d6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:44.274535 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:44.275182 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:44.275462 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:44.275765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:44.285920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:44.287351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:44.296901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1387/2757] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:40:44.516997 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:44.517316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:44.517599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:44.537166 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] MFA Rules not processed for user `57b5f6716b1745b2b3a3d763cdcb4eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:40:44.538389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:44.569626 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:44.571100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:44.583857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213484a-e12d-4937-a9fe-c4e66b14c70e service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:44.588962 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:44.590901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:44.591186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:44.591460 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] PATH_INFO: `/v3/projects/b3cd4bf610ee4d138a7dcf904f68b5e2` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:44.593072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cd4bf610ee4d138a7dcf904f68b5e2)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:44.595552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:44.610769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1371/2758] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:40:44.645657 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cd4bf610ee4d138a7dcf904f68b5e2', 'request_id': 'req-3b22ee72-eef4-4940-a173-74501b006f49'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.652009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cd4bf610ee4d138a7dcf904f68b5e2', 'request_id': 'req-3b22ee72-eef4-4940-a173-74501b006f49'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.659382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cd4bf610ee4d138a7dcf904f68b5e2', 'request_id': 'req-3b22ee72-eef4-4940-a173-74501b006f49'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.675842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] The token cache is being invalidate because project b3cd4bf610ee4d138a7dcf904f68b5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:40:44.676240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.676956 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:40:44.678576 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1388/2759] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:40:44 2022] DELETE /identity/v3/projects/b3cd4bf610ee4d138a7dcf904f68b5e2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:40:54.601422 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=25 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:54.670496 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:56.956410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:40:56.958052 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:57.041937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795db55-386b-48b8-b7df-2a74dd7e394b None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:40:57.108246 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:40:57.108911 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:40:57.109256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:40:57.109473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:40:57.111318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:40:57.124418 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:40:57.126054 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacdc8a-09b3-482b-af30-d936fa32213e service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:40:57.138289 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1372/2760] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:40:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:41:07.133758 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=62 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:41:49.066611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:41:49.068228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:49.151603 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22ee72-eef4-4940-a173-74501b006f49 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:41:49.158254 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:41:49.159192 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:49.159497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:49.159780 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:49.162721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:49.175106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:41:49.176751 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:41:49.187756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1389/2761] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:41:51.414468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:51.414946 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:51.415056 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:51.434640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:41:51.435889 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:51.495706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1373/2762] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:41:51.546664 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:41:51.548552 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:51.620383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ee17-fc0a-42ac-b92b-58c6eddd00e9 service placement] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:41:51.625456 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:41:51.626681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:51.626959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:51.627236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:51.636753 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:41:51.639301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:41:51.651826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1390/2763] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:41:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:41:58.613108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:41:58.615553 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:58.718958 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac66f-3b5a-404c-9059-1058196e1d19 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:41:58.735770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:41:58.736916 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:58.737385 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:58.738390 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] PATH_INFO: `/v3/users/0991de3fb3ee4410953b8984cf16d2ea` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:58.739834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0991de3fb3ee4410953b8984cf16d2ea)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:41:58.742247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:41:58.803163 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0991de3fb3ee4410953b8984cf16d2ea'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:58.803886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0991de3fb3ee4410953b8984cf16d2ea'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:58.813971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0991de3fb3ee4410953b8984cf16d2ea'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:58.830055 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0991de3fb3ee4410953b8984cf16d2ea'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:58.838656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0991de3fb3ee4410953b8984cf16d2ea'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:58.849301 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1374/2764] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:41:58 2022] DELETE /identity/v3/users/0991de3fb3ee4410953b8984cf16d2ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:41:59.085706 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:41:59.105180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdece7d-8ccc-4ba6-b36a-becfffb017fb service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:41:59.181208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:41:59.182299 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:59.182607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:59.183044 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] PATH_INFO: `/v3/projects/36d8bfa61aa445f9a19060bea759f579` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:59.184312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d8bfa61aa445f9a19060bea759f579)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:41:59.186341 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:41:59.213681 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=100 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:41:59.247360 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d8bfa61aa445f9a19060bea759f579', 'request_id': 'req-061f6161-d02f-496e-a1ca-aacdc2c5709e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.253523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d8bfa61aa445f9a19060bea759f579', 'request_id': 'req-061f6161-d02f-496e-a1ca-aacdc2c5709e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.264033 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d8bfa61aa445f9a19060bea759f579', 'request_id': 'req-061f6161-d02f-496e-a1ca-aacdc2c5709e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.287164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] The token cache is being invalidate because project 36d8bfa61aa445f9a19060bea759f579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:41:59.287468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.288389 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.290305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1391/2765] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:41:59 2022] DELETE /identity/v3/projects/36d8bfa61aa445f9a19060bea759f579 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:41:59.294278 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:41:59.296227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:59.313348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e5cdf-bcd7-4010-810c-c30307720d56 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:41:59.342057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:41:59.392346 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:41:59.393730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:59.394357 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:59.394870 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] PATH_INFO: `/v3/users/c7d69d5032c3459686dbd3f5807c87d7` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:59.396516 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d69d5032c3459686dbd3f5807c87d7)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:41:59.398822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:41:59.453372 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d69d5032c3459686dbd3f5807c87d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.454079 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d69d5032c3459686dbd3f5807c87d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.463877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d69d5032c3459686dbd3f5807c87d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.479445 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d69d5032c3459686dbd3f5807c87d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.488775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-55dff1e3-8342-4ae1-85d6-9af2caf20617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d69d5032c3459686dbd3f5807c87d7'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.498417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1375/2766] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:41:59 2022] DELETE /identity/v3/users/c7d69d5032c3459686dbd3f5807c87d7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:41:59.725450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:41:59.727599 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:41:59.750273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f6161-d02f-496e-a1ca-aacdc2c5709e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:41:59.857831 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:41:59.858849 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:41:59.859140 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:41:59.859419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] PATH_INFO: `/v3/projects/714d45bebc41486786cfced585f92980` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:41:59.860779 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714d45bebc41486786cfced585f92980)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:41:59.862866 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:41:59.940944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714d45bebc41486786cfced585f92980', 'request_id': 'req-f3d9319f-6f80-4dd3-b909-973c02c297f6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.952904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714d45bebc41486786cfced585f92980', 'request_id': 'req-f3d9319f-6f80-4dd3-b909-973c02c297f6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.958195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714d45bebc41486786cfced585f92980', 'request_id': 'req-f3d9319f-6f80-4dd3-b909-973c02c297f6'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.974362 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] The token cache is being invalidate because project 714d45bebc41486786cfced585f92980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:41:59.974564 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.975188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:41:59.977005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1392/2767] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:41:59 2022] DELETE /identity/v3/projects/714d45bebc41486786cfced585f92980 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:42:08.474895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7638-9ad0-4847-9623-e469a153e1e2 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:42:08.475356 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7638-9ad0-4847-9623-e469a153e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:42:08.475466 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7638-9ad0-4847-9623-e469a153e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:42:08.493605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-d65b7638-9ad0-4847-9623-e469a153e1e2 None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:42:08.494778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-d65b7638-9ad0-4847-9623-e469a153e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:42:08.551436 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1376/2768] 10.222.0.25 () {58 vars in 1009 bytes} [Thu May 19 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:42:08.563347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:42:08.564822 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:42:08.609215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:08.636566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9319f-6f80-4dd3-b909-973c02c297f6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:42:08.642061 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:42:08.642709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:42:08.642995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:42:08.643274 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:42:08.653169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:42:08.654862 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:42:08.663607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1393/2769] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:42:18.544258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:18.660401 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=14 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:23.163549 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:42:23.164107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:42:23.164207 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:42:23.182540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] MFA Rules not processed for user `4906e8d75de84c509617bc354ed860c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:42:23.183824 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:42:23.190999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1377/2770] 10.222.0.25 () {58 vars in 967 bytes} [Thu May 19 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:42:23.203544 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:42:23.214262 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d6ad-72ae-4d1f-a247-e497ee10b879 service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:42:23.219183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd270113b79534fadbb15eb81eb547a5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:42:23.220339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:42:23.220624 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:42:23.220901 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:42:23.229148 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:42:23.230743 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:42:23.239493 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1394/2771] 10.222.0.25 () {60 vars in 1384 bytes} [Thu May 19 16:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 16:42:33.177229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:33.236159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=6 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:06.501424 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:06.504269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:06.612292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e86ff6-dd2e-4941-bf8b-0acf4b9a719d None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:06.618020 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:06.619023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:06.619652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:06.620047 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] PATH_INFO: `/v3/users/57b5f6716b1745b2b3a3d763cdcb4eca` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:06.621644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b5f6716b1745b2b3a3d763cdcb4eca)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:06.623856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:06.686631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b5f6716b1745b2b3a3d763cdcb4eca'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:06.687376 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b5f6716b1745b2b3a3d763cdcb4eca'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:06.700229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b5f6716b1745b2b3a3d763cdcb4eca'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:06.716494 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b5f6716b1745b2b3a3d763cdcb4eca'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:06.726174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-2dfb9465-5c3b-4804-8873-bd37148ea00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b5f6716b1745b2b3a3d763cdcb4eca'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:06.733643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1378/2772] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:43:06 2022] DELETE /identity/v3/users/57b5f6716b1745b2b3a3d763cdcb4eca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:43:06.949322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:06.967313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7bfdc-7078-4b7f-8d2c-b93f7d7e7b88 service swift] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.065696 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.067215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.067752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.068260 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] PATH_INFO: `/v3/projects/3cca2283f1394927a7aaaa534e265663` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.070395 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cca2283f1394927a7aaaa534e265663)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.074185 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.140372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cca2283f1394927a7aaaa534e265663', 'request_id': 'req-67a33f96-3414-4474-af80-4f59626c15fa'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:07.147318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cca2283f1394927a7aaaa534e265663', 'request_id': 'req-67a33f96-3414-4474-af80-4f59626c15fa'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:07.154752 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cca2283f1394927a7aaaa534e265663', 'request_id': 'req-67a33f96-3414-4474-af80-4f59626c15fa'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:07.170815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] The token cache is being invalidate because project 3cca2283f1394927a7aaaa534e265663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:43:07.171188 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:07.172223 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-67a33f96-3414-4474-af80-4f59626c15fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:43:07.173918 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1395/2773] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:43:06 2022] DELETE /identity/v3/projects/3cca2283f1394927a7aaaa534e265663 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:43:07.179611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.180061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.180433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.199886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:43:07.201112 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:07.270545 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1379/2774] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:43:07.280655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.281012 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.281372 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.304215 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:43:07.305501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:07.314568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1396/2775] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:43:07.319360 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.330701 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a8da-86b9-4251-a220-962f0a9668c6 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.335873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.336590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.336878 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.337159 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.337917 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:43:07.338231 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.339944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.357970 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1380/2776] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:43:07.362887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.372986 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ef25-3260-42e9-9634-fa8e773497e9 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.378645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.379332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.379644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.379933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.380943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.382957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.417592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1397/2777] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:43:07 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:43:07.422276 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.434239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d18c-b90e-4c83-907d-13c9c4d2c534 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.439250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:07.513809 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.514894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.514894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.515239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.515810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.517836 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.542562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1381/2778] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:43:07 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:43:07.548536 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.567595 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1285-031c-4bb4-92ca-52a4834ae3d4 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.576051 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.577240 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.577758 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.578268 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.579846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.583032 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.606335 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1398/2779] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:43:07.611243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.622440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fdf3b-a6bf-4c6a-a9c2-7372ffc68b62 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.629131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5d146-88d3-4a82-ae83-3d8a3e39d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.629855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d146-88d3-4a82-ae83-3d8a3e39d3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.630069 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d146-88d3-4a82-ae83-3d8a3e39d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.630691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d146-88d3-4a82-ae83-3d8a3e39d3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.631453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5d146-88d3-4a82-ae83-3d8a3e39d3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.633180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5d146-88d3-4a82-ae83-3d8a3e39d3a1 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.645317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1382/2780] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:43:07.649589 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.664892 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479aee-3d0b-44e2-83c4-d76a59ccd006 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.674123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.675607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.676180 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.676682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] PATH_INFO: `/v3/projects/4966196b5fe24b1cbb7e212bf96be8aa/users/b93de588f287414fac1df859e9396305/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.704721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4966196b5fe24b1cbb7e212bf96be8aa, user_id=b93de588f287414fac1df859e9396305, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.708427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.730034 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1399/2781] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:43:07 2022] PUT /identity/v3/projects/4966196b5fe24b1cbb7e212bf96be8aa/users/b93de588f287414fac1df859e9396305/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:43:07.737978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad234b71-f963-45dd-b990-91d05a7ca229 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.738361 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad234b71-f963-45dd-b990-91d05a7ca229 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.738718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad234b71-f963-45dd-b990-91d05a7ca229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.760343 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ad234b71-f963-45dd-b990-91d05a7ca229 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:43:07.761804 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ad234b71-f963-45dd-b990-91d05a7ca229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:07.831215 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1383/2782] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:43:07.841959 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:07.844326 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:07.880910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:07.917190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ef2b-4d24-4cbd-964a-90a5b2d805ce admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:07.921273 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:07.922577 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:07.922857 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:07.923131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:07.935404 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:07.936887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:07.949826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1400/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:43:13.262894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ebb1-2b3d-4d74-a0d1-05922e08f4ad None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:13.263796 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ebb1-2b3d-4d74-a0d1-05922e08f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:13.264120 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ebb1-2b3d-4d74-a0d1-05922e08f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:13.315327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-9ba6ebb1-2b3d-4d74-a0d1-05922e08f4ad None None] MFA Rules not processed for user `b93de588f287414fac1df859e9396305`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:43:13.317873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-9ba6ebb1-2b3d-4d74-a0d1-05922e08f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:13.439074 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1384/2784] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 16:43:13.462623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:13.465747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:13.579774 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d87e-9f9b-4e42-aab3-882c08c62841 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:13.589792 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:13.591036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:13.591407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:13.591957 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:13.608305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:13.611297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:13.631473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1401/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:43:15.368816 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:15.369483 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:15.369778 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:15.401334 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] MFA Rules not processed for user `b93de588f287414fac1df859e9396305`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:43:15.403662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:15.416453 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1385/2786] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:43:15.493025 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:15.495052 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:15.569455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cc25-8146-4753-b58e-8c9345157399 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:15.573950 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9abdf0cdb63429d926f201034fb72ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:15.574647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:15.574936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:15.575382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:15.577623 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:15.597440 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:15.600523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:15.622869 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1402/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:43:16.614053 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:16.636332 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f7d88-4c0c-478e-a209-56c051941ece None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:16.646236 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:16.648182 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:16.650051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:16.651098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:16.658498 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:16.689331 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:16.698012 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:16.702267 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e787d-c9ed-455b-a1ed-841932828515 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:16.729886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1386/2788] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:43:25.612843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=74 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:26.351204 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:43:26.362186 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776a3a6-3de7-4792-a12c-b0a71656bffc service glance] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:43:26.366390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:43:26.367129 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:43:26.367523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:43:26.367909 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:43:26.370426 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:43:26.382725 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:43:26.384346 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:43:26.395000 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1403/2789] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:43:26.717784 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=2 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:36.389772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=6 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:43.271212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:45:43.271850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:45:43.271850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:45:43.298983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] MFA Rules not processed for user `b93de588f287414fac1df859e9396305`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:45:43.300736 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:43.325746 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1387/2790] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:45:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:45:43.636948 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:45:43.673607 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230f56b-9541-4e04-9dd3-f751c7876fab service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:45:43.677815 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:45:43.678461 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:45:43.678741 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:45:43.679013 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:45:43.680871 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:43.703692 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:45:43.705228 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:45:43.713852 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1404/2791] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:45:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:45:44.062258 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:45:44.063731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:44.145348 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8381be4-1c87-4f0c-b37d-4adbf9347415 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:45:44.150294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:45:44.150945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:45:44.151227 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:45:44.151502 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:45:44.153340 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:44.165255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:45:44.166867 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:45:44.176739 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1388/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:45:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:45:50.840531 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:45:50.872470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f8bb-33b1-4d0a-929a-f2911648f874 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:45:50.878409 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:45:50.879066 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:45:50.879479 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:45:50.880669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:45:50.884434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:50.916619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:45:50.918428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:45:50.930674 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1405/2793] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:45:54.172600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=50 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:54.774058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:45:54.775558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:54.791375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a2a14-2183-48eb-af15-7c71778c2864 service placement] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:45:54.796854 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:45:54.797506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:45:54.797786 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:45:54.798061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:45:54.800417 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:45:54.813408 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:45:54.814773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:45:54.826729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1389/2794] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:46:00.925519 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=41 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:04.821652 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=6 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:41.734322 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:41.762171 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b43193-4948-4f73-bfbb-289437980f79 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:41.768399 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:41.769068 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:41.769355 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:41.769637 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:41.772112 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:41.785821 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:41.787528 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:41.799838 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1406/2795] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:46:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:46:49.680999 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:49.740605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5b882-6bc6-440b-aeaa-0e249511f8ff service nova] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:49.745846 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:49.746751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:49.747040 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:49.747349 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] PATH_INFO: `/v3/users/b93de588f287414fac1df859e9396305` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:49.748695 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93de588f287414fac1df859e9396305)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:49.750693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:49.814433 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93de588f287414fac1df859e9396305'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:49.815065 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93de588f287414fac1df859e9396305'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:49.823448 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93de588f287414fac1df859e9396305'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:49.837952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93de588f287414fac1df859e9396305'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:49.845325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-fe4b7982-53e9-4c7b-8fdf-1a289aa82910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93de588f287414fac1df859e9396305'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:49.852253 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1390/2796] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:46:49 2022] DELETE /identity/v3/users/b93de588f287414fac1df859e9396305 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:50.033082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.044047 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc803-4f81-42d4-b54f-2c27216a7d61 service nova] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.102121 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.102980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.103263 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.103540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] PATH_INFO: `/v3/projects/4966196b5fe24b1cbb7e212bf96be8aa` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.104766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4966196b5fe24b1cbb7e212bf96be8aa)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.106695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.153887 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4966196b5fe24b1cbb7e212bf96be8aa', 'request_id': 'req-5cc8c3ce-5638-4481-be75-1ec80b1debe2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:50.159642 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4966196b5fe24b1cbb7e212bf96be8aa', 'request_id': 'req-5cc8c3ce-5638-4481-be75-1ec80b1debe2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:50.165759 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4966196b5fe24b1cbb7e212bf96be8aa', 'request_id': 'req-5cc8c3ce-5638-4481-be75-1ec80b1debe2'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:50.190119 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] The token cache is being invalidate because project 4966196b5fe24b1cbb7e212bf96be8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:46:50.190414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:50.191030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-5cc8c3ce-5638-4481-be75-1ec80b1debe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:50.192619 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1407/2797] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:46:50 2022] DELETE /identity/v3/projects/4966196b5fe24b1cbb7e212bf96be8aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:50.198179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.198468 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.198747 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.253609 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:50.255068 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:50.312574 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1391/2798] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:50.320973 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.321193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.321472 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.339450 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:50.340678 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:50.348985 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1408/2799] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:50.353270 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.362834 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a3ce8-8247-4923-ab14-071399806cde None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.367465 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.368140 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.368427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.368709 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.369431 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:46:50.369741 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.371345 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.383641 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1392/2800] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:46:50.387834 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.397515 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924d8e-be53-422a-afa3-7e8c44253f68 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.402116 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.402757 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.403037 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.403310 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.404036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.405936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.431856 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1409/2801] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:46:50 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:46:50.435967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.446573 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f694e-a932-482d-af41-90f7c8f1a980 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.455413 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:50.505025 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.506479 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.506877 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.507266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.508114 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.510161 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.529718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1393/2802] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:46:50 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:50.533853 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.544211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c6e5-9c14-4be0-b845-19a19cdd8176 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.548790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.549449 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.549730 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.550003 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.550722 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.553137 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.563691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1410/2803] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:50.567511 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.578729 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9e8e6-e049-4139-ad3a-b0da68e66f40 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.583399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c905a-479f-4f18-876c-574bc7dfd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.584083 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c905a-479f-4f18-876c-574bc7dfd4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.584365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c905a-479f-4f18-876c-574bc7dfd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.584640 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c905a-479f-4f18-876c-574bc7dfd4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.585393 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c905a-479f-4f18-876c-574bc7dfd4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.586981 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c905a-479f-4f18-876c-574bc7dfd4fd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.597228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1394/2804] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:50.601610 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.611468 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35b2d-e32d-4cb0-b6dd-82b3769e7792 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.616608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.617471 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.617747 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.618015 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] PATH_INFO: `/v3/projects/4de3bcaf4be24c0fb2d86b9d57bf1a83/users/94c4bfa095024346a2fc30cc3b52b534/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.633098 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de3bcaf4be24c0fb2d86b9d57bf1a83, user_id=94c4bfa095024346a2fc30cc3b52b534, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.635804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.648534 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1411/2805] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:46:50 2022] PUT /identity/v3/projects/4de3bcaf4be24c0fb2d86b9d57bf1a83/users/94c4bfa095024346a2fc30cc3b52b534/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:46:50.658438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.658737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.659026 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.686164 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] MFA Rules not processed for user `94c4bfa095024346a2fc30cc3b52b534`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:50.687379 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:50.753667 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1395/2806] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:50.765705 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:50.767433 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:50.773111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:50.857428 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b190a-fc0d-4efc-938e-4f38e6fe2e87 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:50.862980 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3126-bd13-46c0-ac23-c47d68b1c516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd16048e5244f4adc3f5859d6ea8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:50.863682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3126-bd13-46c0-ac23-c47d68b1c516 service nova] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:50.863963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3126-bd13-46c0-ac23-c47d68b1c516 service nova] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:50.864265 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3126-bd13-46c0-ac23-c47d68b1c516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:50.873954 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3126-bd13-46c0-ac23-c47d68b1c516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:50.875638 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3126-bd13-46c0-ac23-c47d68b1c516 service nova] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:50.886038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1412/2807] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:46:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:46:56.108113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:56.170584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319969e1-ef74-49b8-9ddf-3d4c55629247 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:56.175496 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:56.176398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.176678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.176956 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] PATH_INFO: `/v3/users/94c4bfa095024346a2fc30cc3b52b534` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.178156 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c4bfa095024346a2fc30cc3b52b534)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:56.180176 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:56.203081 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:56.229522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c4bfa095024346a2fc30cc3b52b534'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.230186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c4bfa095024346a2fc30cc3b52b534'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.238355 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c4bfa095024346a2fc30cc3b52b534'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.250488 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c4bfa095024346a2fc30cc3b52b534'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.258011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c4bfa095024346a2fc30cc3b52b534'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.263913 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1396/2808] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:46:56 2022] DELETE /identity/v3/users/94c4bfa095024346a2fc30cc3b52b534 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:56.268586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.269168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.269168 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.286518 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:56.287832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:56.344878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1413/2809] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:56.355087 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:56.356522 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:56.413962 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5b013-5458-499d-8eed-c957503d55f5 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:56.417558 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a5cb5-2608-449d-b942-0cfc24c98aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:56.418205 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a5cb5-2608-449d-b942-0cfc24c98aff service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.418492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a5cb5-2608-449d-b942-0cfc24c98aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.418777 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a5cb5-2608-449d-b942-0cfc24c98aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.427837 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a5cb5-2608-449d-b942-0cfc24c98aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:56.429942 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a5cb5-2608-449d-b942-0cfc24c98aff service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:56.439294 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1397/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:46:56.726754 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:56.728191 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:56.740247 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eeec2-3283-4ff1-b137-a88bf923cf00 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:56.746898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:56.747811 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.748149 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.748414 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] PATH_INFO: `/v3/projects/4de3bcaf4be24c0fb2d86b9d57bf1a83` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.749615 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de3bcaf4be24c0fb2d86b9d57bf1a83)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:56.753141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:56.803272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de3bcaf4be24c0fb2d86b9d57bf1a83', 'request_id': 'req-e52862ec-6195-4d9a-bad6-63eb624df3ef'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.809690 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de3bcaf4be24c0fb2d86b9d57bf1a83', 'request_id': 'req-e52862ec-6195-4d9a-bad6-63eb624df3ef'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.816002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de3bcaf4be24c0fb2d86b9d57bf1a83', 'request_id': 'req-e52862ec-6195-4d9a-bad6-63eb624df3ef'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.829867 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] The token cache is being invalidate because project 4de3bcaf4be24c0fb2d86b9d57bf1a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:46:56.830159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.830800 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-e52862ec-6195-4d9a-bad6-63eb624df3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:56.832485 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1414/2811] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:46:56 2022] DELETE /identity/v3/projects/4de3bcaf4be24c0fb2d86b9d57bf1a83 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:46:56.837404 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.837696 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.837978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.856255 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:56.857486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:56.920517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1398/2812] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:56.928407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.929238 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.929522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.951704 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:56.952913 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:56.961466 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1415/2813] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:56.965731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:56.975977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256993f4-adc2-450d-9172-6e349cf3cc14 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:56.980646 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:56.981313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:56.981598 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:56.981873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:56.982614 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:46:56.982929 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:56.984603 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:56.996708 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1399/2814] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:46:57.001016 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.007550 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:57.011566 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0ddc-ab12-42c9-8210-1f9838f6eb77 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.019152 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.020114 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.020644 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.020942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.021712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.024514 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.050648 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1416/2815] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:46:57 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:57.054926 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.065035 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8a5a-c2db-4e68-ae08-cedb2e804cc7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.096208 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:57.125822 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.126486 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.126754 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.127030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.127745 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.129924 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.149543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1400/2816] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:46:57 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:57.153634 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.163842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219e433-be44-4b11-bbc2-ab03efeeb764 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.168446 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.169107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.169386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.169660 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.170385 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.172036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.183305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1417/2817] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:57.189325 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.203751 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a5b3-75dd-4509-9d20-b706553e3e0a admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.213129 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78c7e-0b5e-43d9-9140-aafe1ba0cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.213825 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78c7e-0b5e-43d9-9140-aafe1ba0cd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.214111 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78c7e-0b5e-43d9-9140-aafe1ba0cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.214387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78c7e-0b5e-43d9-9140-aafe1ba0cd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.215169 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78c7e-0b5e-43d9-9140-aafe1ba0cd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.216807 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78c7e-0b5e-43d9-9140-aafe1ba0cd97 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.227669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1401/2818] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:57.231878 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.242383 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7680fd-350f-4adf-9744-d3e05c3b7885 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.247091 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.247947 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.248233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.248513 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] PATH_INFO: `/v3/projects/20df088da863466ba50927ea23aa484d/users/eb1e20b2990043238fcd6fd9651b3e16/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.263806 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20df088da863466ba50927ea23aa484d, user_id=eb1e20b2990043238fcd6fd9651b3e16, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.266488 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.279497 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1418/2819] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:46:57 2022] PUT /identity/v3/projects/20df088da863466ba50927ea23aa484d/users/eb1e20b2990043238fcd6fd9651b3e16/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:57.289532 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.289823 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.290106 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.316533 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] MFA Rules not processed for user `eb1e20b2990043238fcd6fd9651b3e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:57.317730 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:57.380939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1402/2820] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:57.385393 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.445963 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d469c7a-95b0-4fb5-96f3-2dae0c6c5aa9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.450533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.451189 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.451473 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.451791 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.452480 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.454434 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.480580 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1419/2821] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:46:57 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:57.484831 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.495419 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30885dd5-6e6f-48e0-a139-9e9eb233db11 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.559662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.560291 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.560616 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.560884 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.561595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.563649 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.583637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1403/2822] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:46:57 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:57.587700 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.598005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea70e9-998e-4be4-aaa6-114542e2feec admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.603245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.603974 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.604256 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.604529 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.605257 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.606883 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.618100 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1420/2823] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:57.622212 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.632399 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad51be-5261-4a2e-bcc1-7d41602c56b6 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.636951 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.637832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.638118 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.638398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] PATH_INFO: `/v3/projects/2ef158c0bdda433aae2df02ba469c85a/users/d2b2bf25839e4ad29c8866cc0551b6fc/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.652909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef158c0bdda433aae2df02ba469c85a, user_id=d2b2bf25839e4ad29c8866cc0551b6fc, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.655563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.668769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1404/2824] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:46:57 2022] PUT /identity/v3/projects/2ef158c0bdda433aae2df02ba469c85a/users/d2b2bf25839e4ad29c8866cc0551b6fc/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:57.673339 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.684817 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310950b-f99a-4318-9096-8ca10a98245c admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.742910 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff14f3-30fd-4e0a-93b0-1ce108b377a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.743591 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff14f3-30fd-4e0a-93b0-1ce108b377a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.743912 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff14f3-30fd-4e0a-93b0-1ce108b377a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.744190 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff14f3-30fd-4e0a-93b0-1ce108b377a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.744927 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff14f3-30fd-4e0a-93b0-1ce108b377a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.746547 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff14f3-30fd-4e0a-93b0-1ce108b377a1 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.758266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1421/2825] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:57.762590 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.769437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:57.773503 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188328-76c5-471a-9900-bdb808592119 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:57.779539 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:57.780493 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.780781 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.781059 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] PATH_INFO: `/v3/projects/2ef158c0bdda433aae2df02ba469c85a/users/d2b2bf25839e4ad29c8866cc0551b6fc/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.783188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef158c0bdda433aae2df02ba469c85a, user_id=d2b2bf25839e4ad29c8866cc0551b6fc, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:57.786150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:57.797797 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1405/2826] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:46:57 2022] PUT /identity/v3/projects/2ef158c0bdda433aae2df02ba469c85a/users/d2b2bf25839e4ad29c8866cc0551b6fc/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:57.810099 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:57.810313 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:57.810596 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:57.838843 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] MFA Rules not processed for user `d2b2bf25839e4ad29c8866cc0551b6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:57.840097 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:57.845374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:57.913983 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1422/2827] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:57.924840 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:57.926611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:58.008396 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f79a27-0f57-494c-96d1-c4affec782bb admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:58.012051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a002ae-88e9-40d0-8dd7-3804a932ce54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:58.012697 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a002ae-88e9-40d0-8dd7-3804a932ce54 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:58.012983 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a002ae-88e9-40d0-8dd7-3804a932ce54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:58.013263 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a002ae-88e9-40d0-8dd7-3804a932ce54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:58.022204 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a002ae-88e9-40d0-8dd7-3804a932ce54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:58.023670 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a002ae-88e9-40d0-8dd7-3804a932ce54 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:58.033004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1406/2828] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:46:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:46:58.161846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:58.223900 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a83d3-c3d0-4041-a17b-acaf091b8f6d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:58.229244 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:58.230130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:58.230415 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:58.230689 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] PATH_INFO: `/v3/users/eb1e20b2990043238fcd6fd9651b3e16` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:58.231933 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1e20b2990043238fcd6fd9651b3e16)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:58.234208 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:58.284084 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1e20b2990043238fcd6fd9651b3e16'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.284820 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1e20b2990043238fcd6fd9651b3e16'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.292368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1e20b2990043238fcd6fd9651b3e16'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.304942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1e20b2990043238fcd6fd9651b3e16'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.305609 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1e20b2990043238fcd6fd9651b3e16'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.317889 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1423/2829] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:46:58 2022] DELETE /identity/v3/users/eb1e20b2990043238fcd6fd9651b3e16 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:58.322963 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:58.323451 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:58.323566 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:58.341057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:58.342592 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:58.400945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1407/2830] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:58.410830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:58.412072 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:58.438675 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:58.471895 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15186824-cedd-4e04-8031-613591814b7a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:58.475655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:58.476301 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:58.476582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:58.476863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:58.485850 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:58.487293 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:58.496707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1424/2831] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:46:58.768347 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:58.769893 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:58.783541 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6faec2-e09a-4f7f-b619-7f7305daaf8e None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:58.789023 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:58.789915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:58.790194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:58.790467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] PATH_INFO: `/v3/projects/20df088da863466ba50927ea23aa484d` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:58.791757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20df088da863466ba50927ea23aa484d)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:58.793693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:58.841016 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20df088da863466ba50927ea23aa484d', 'request_id': 'req-e3bc270c-f37c-40ed-a4f0-277129655a26'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.846653 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20df088da863466ba50927ea23aa484d', 'request_id': 'req-e3bc270c-f37c-40ed-a4f0-277129655a26'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.853409 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20df088da863466ba50927ea23aa484d', 'request_id': 'req-e3bc270c-f37c-40ed-a4f0-277129655a26'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.861914 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:58.867665 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] The token cache is being invalidate because project 20df088da863466ba50927ea23aa484d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:46:58.868051 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.869033 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:58.871113 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1408/2832] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:46:58 2022] DELETE /identity/v3/projects/20df088da863466ba50927ea23aa484d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:58.875088 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:58.886427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c454d6-13aa-4bef-aed9-3fe997069d57 service neutron] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:58.945859 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:58.946742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:58.947024 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:58.947375 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] PATH_INFO: `/v3/users/d2b2bf25839e4ad29c8866cc0551b6fc` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:58.948604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b2bf25839e4ad29c8866cc0551b6fc)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:58.950567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.003036 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b2bf25839e4ad29c8866cc0551b6fc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.003771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b2bf25839e4ad29c8866cc0551b6fc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.013444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b2bf25839e4ad29c8866cc0551b6fc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.027419 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b2bf25839e4ad29c8866cc0551b6fc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.028201 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a46a3bcb-a873-448a-9a02-ea36fc803e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b2bf25839e4ad29c8866cc0551b6fc'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.041107 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1425/2833] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:46:58 2022] DELETE /identity/v3/users/d2b2bf25839e4ad29c8866cc0551b6fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:59.329938 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.331478 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:59.347731 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc270c-f37c-40ed-a4f0-277129655a26 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.407691 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.408475 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.408757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.409030 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] PATH_INFO: `/v3/projects/2ef158c0bdda433aae2df02ba469c85a` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.410225 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef158c0bdda433aae2df02ba469c85a)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.412194 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.461107 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef158c0bdda433aae2df02ba469c85a', 'request_id': 'req-637c186c-672c-45ea-a01e-c993faddc5b3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.467230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef158c0bdda433aae2df02ba469c85a', 'request_id': 'req-637c186c-672c-45ea-a01e-c993faddc5b3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.473584 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef158c0bdda433aae2df02ba469c85a', 'request_id': 'req-637c186c-672c-45ea-a01e-c993faddc5b3'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.486890 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] The token cache is being invalidate because project 2ef158c0bdda433aae2df02ba469c85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:46:59.487184 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.487852 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-637c186c-672c-45ea-a01e-c993faddc5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:46:59.489410 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1409/2834] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:46:59 2022] DELETE /identity/v3/projects/2ef158c0bdda433aae2df02ba469c85a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:59.494771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.495229 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.495354 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.513745 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:59.514972 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:59.557380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:59.580586 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1426/2835] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:59.589098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.589383 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.589666 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.609790 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:59.611002 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:46:59.623183 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1410/2836] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:46:59.624111 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.634503 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17d452-252e-4f0e-960f-bdbd81febfe6 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.639327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.640030 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.640318 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.640685 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.641384 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:46:59.641699 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.643321 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.659695 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1427/2837] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 16:46:59.663639 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.671606 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c5f2-1219-473a-acda-76154e80c856 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.676902 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.677563 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.677844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.678122 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.678855 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.680810 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.715979 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1411/2838] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:46:59 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:59.717425 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.728242 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee850e-b793-42aa-9551-7bf7fdcdf9ee admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.786772 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.787588 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.787936 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.788224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.788920 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.790860 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.814818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1428/2839] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:46:59 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:46:59.816173 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.827720 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d243-db5a-47ad-b313-7bd92cb355ed admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.832578 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.833247 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.833530 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.833805 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.834536 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.836886 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.847474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1412/2840] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:59.851568 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.861882 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fb950-80cd-461d-8bc0-75b298acacba admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.866808 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b44db-9472-496b-84f1-f2ff634f9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.867521 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b44db-9472-496b-84f1-f2ff634f9def admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.867848 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b44db-9472-496b-84f1-f2ff634f9def admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.868131 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b44db-9472-496b-84f1-f2ff634f9def admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.868896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b44db-9472-496b-84f1-f2ff634f9def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.870545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b44db-9472-496b-84f1-f2ff634f9def admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.881019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1429/2841] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:46:59.886015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:46:59.896611 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b8bd-6849-42ec-a5df-a155f89757dc admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:46:59.901961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:46:59.902844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.903158 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.903437 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] PATH_INFO: `/v3/projects/0965cf6f7aaa4d448880b5153e19eb3f/users/f3b181e33a0a4c2f9a8dc36d680635d8/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.918344 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0965cf6f7aaa4d448880b5153e19eb3f, user_id=f3b181e33a0a4c2f9a8dc36d680635d8, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:46:59.921003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:46:59.934655 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1413/2842] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:46:59 2022] PUT /identity/v3/projects/0965cf6f7aaa4d448880b5153e19eb3f/users/f3b181e33a0a4c2f9a8dc36d680635d8/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:46:59.945459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:46:59.945756 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:46:59.946038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:46:59.972559 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] MFA Rules not processed for user `f3b181e33a0a4c2f9a8dc36d680635d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:46:59.973760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:00.039245 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1430/2843] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:00.043770 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.071179 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:00.110269 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8ea8-692d-4156-bfdf-d707832e1b30 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.115048 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.115749 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.116562 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.116845 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.117550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.119473 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.146321 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1414/2844] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:47:00 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:00.150712 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.161697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b670e60-071c-4496-8f05-2170c7d1e575 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.201474 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:00.221444 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.222124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.222431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.222701 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.223386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.225345 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.245494 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1431/2845] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:47:00 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:00.249476 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.261061 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe88c6-3d80-40f4-becd-80db7c479df7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.265552 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.266202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.266484 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.266761 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.267487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.269155 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.279905 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1415/2846] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:00.283942 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.294332 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306932-89d7-4e71-be2d-b3d6e3b808f9 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.299011 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.300002 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.300327 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.300549 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] PATH_INFO: `/v3/projects/97ca95603e184e5d9f250e1b5b06a337/users/e112723a1b474dd991a09d79e553b617/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.316388 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ca95603e184e5d9f250e1b5b06a337, user_id=e112723a1b474dd991a09d79e553b617, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.319703 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.332181 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1432/2847] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:47:00 2022] PUT /identity/v3/projects/97ca95603e184e5d9f250e1b5b06a337/users/e112723a1b474dd991a09d79e553b617/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:00.336131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.346005 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36130-d684-4e6f-b1d1-54b18f11a0d0 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.403517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f35385-345c-4aa0-ba95-86da03fceec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.404219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f35385-345c-4aa0-ba95-86da03fceec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.404507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f35385-345c-4aa0-ba95-86da03fceec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.404815 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f35385-345c-4aa0-ba95-86da03fceec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.405543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f35385-345c-4aa0-ba95-86da03fceec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.407175 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f35385-345c-4aa0-ba95-86da03fceec2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.417540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1416/2848] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:00.421729 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.431898 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678fba-c60a-4358-b2b3-e44b3e40ede6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.436455 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.437324 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.437604 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.437877 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] PATH_INFO: `/v3/projects/97ca95603e184e5d9f250e1b5b06a337/users/e112723a1b474dd991a09d79e553b617/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.439841 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ca95603e184e5d9f250e1b5b06a337, user_id=e112723a1b474dd991a09d79e553b617, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.442492 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.454200 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1433/2849] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:47:00 2022] PUT /identity/v3/projects/97ca95603e184e5d9f250e1b5b06a337/users/e112723a1b474dd991a09d79e553b617/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:00.518342 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.518630 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.518909 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.547004 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] MFA Rules not processed for user `e112723a1b474dd991a09d79e553b617`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:00.548313 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:00.620474 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1417/2850] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:00.632691 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:00.634381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:00.691533 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e912a4-2a87-43d5-9b2f-e15159ca2fd0 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:00.695770 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758b790-1918-456e-8d52-53b5c5a76477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:00.696423 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758b790-1918-456e-8d52-53b5c5a76477 service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:00.696709 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758b790-1918-456e-8d52-53b5c5a76477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:00.696988 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758b790-1918-456e-8d52-53b5c5a76477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:00.706789 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758b790-1918-456e-8d52-53b5c5a76477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:00.708211 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758b790-1918-456e-8d52-53b5c5a76477 service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:00.718760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1434/2851] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:02.287336 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:02.308921 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:02.351082 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8670b-e763-4a34-b9de-9c91dd415566 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:02.355568 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:02.356492 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:02.357131 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:02.357415 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] PATH_INFO: `/v3/users/f3b181e33a0a4c2f9a8dc36d680635d8` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:02.358610 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b181e33a0a4c2f9a8dc36d680635d8)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:02.360597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:02.407859 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b181e33a0a4c2f9a8dc36d680635d8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:02.408543 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b181e33a0a4c2f9a8dc36d680635d8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:02.415535 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b181e33a0a4c2f9a8dc36d680635d8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:02.427898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b181e33a0a4c2f9a8dc36d680635d8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:02.435256 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b181e33a0a4c2f9a8dc36d680635d8'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:02.441139 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1418/2852] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:47:02 2022] DELETE /identity/v3/users/f3b181e33a0a4c2f9a8dc36d680635d8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:02.446361 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:02.446844 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:02.447050 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:02.464567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:02.465771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:02.528103 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1435/2853] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:02.538011 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:02.539440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:02.623259 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2a101-bcff-4b1b-b96a-87dda9c63d30 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:02.626971 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:02.627650 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:02.627948 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:02.628229 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:02.639180 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:02.640908 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:02.652320 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1419/2854] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:02.950277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:02.952074 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:02.966477 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb0cd-83bf-4af4-8fdb-129958f628fa None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:02.973407 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:02.974673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:02.974673 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:02.975071 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] PATH_INFO: `/v3/projects/0965cf6f7aaa4d448880b5153e19eb3f` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:02.977334 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0965cf6f7aaa4d448880b5153e19eb3f)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:02.979438 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:03.016153 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:03.032439 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0965cf6f7aaa4d448880b5153e19eb3f', 'request_id': 'req-a9909175-ff52-4ebf-81fc-421d5d57b34e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.039904 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0965cf6f7aaa4d448880b5153e19eb3f', 'request_id': 'req-a9909175-ff52-4ebf-81fc-421d5d57b34e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.046194 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0965cf6f7aaa4d448880b5153e19eb3f', 'request_id': 'req-a9909175-ff52-4ebf-81fc-421d5d57b34e'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.059382 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] The token cache is being invalidate because project 0965cf6f7aaa4d448880b5153e19eb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:47:03.059714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.060347 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.061925 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1436/2855] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:47:02 2022] DELETE /identity/v3/projects/0965cf6f7aaa4d448880b5153e19eb3f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:03.065915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:03.075656 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b87c7-084f-43c8-a840-98031156e72c service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:03.120201 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:03.139872 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:03.140662 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:03.140945 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:03.141219 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] PATH_INFO: `/v3/users/e112723a1b474dd991a09d79e553b617` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:03.142506 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e112723a1b474dd991a09d79e553b617)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:03.144507 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:03.206287 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e112723a1b474dd991a09d79e553b617'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.206967 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e112723a1b474dd991a09d79e553b617'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.216144 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e112723a1b474dd991a09d79e553b617'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.230722 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e112723a1b474dd991a09d79e553b617'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.238992 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-51f43798-1aa9-49fe-9ce2-3fcf266e62f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e112723a1b474dd991a09d79e553b617'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.251363 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1420/2856] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:47:03 2022] DELETE /identity/v3/users/e112723a1b474dd991a09d79e553b617 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:03.556054 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:03.557651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:03.574403 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9909175-ff52-4ebf-81fc-421d5d57b34e admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:03.641159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:03.642083 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:03.642311 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:03.642592 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] PATH_INFO: `/v3/projects/97ca95603e184e5d9f250e1b5b06a337` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:03.643837 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ca95603e184e5d9f250e1b5b06a337)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:03.645786 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:03.695374 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ca95603e184e5d9f250e1b5b06a337', 'request_id': 'req-6c99d38e-75b8-4d7f-b8e3-0403222dd891'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.700737 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ca95603e184e5d9f250e1b5b06a337', 'request_id': 'req-6c99d38e-75b8-4d7f-b8e3-0403222dd891'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.707106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ca95603e184e5d9f250e1b5b06a337', 'request_id': 'req-6c99d38e-75b8-4d7f-b8e3-0403222dd891'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.722669 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] The token cache is being invalidate because project 97ca95603e184e5d9f250e1b5b06a337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:47:03.723010 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.723651 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-6c99d38e-75b8-4d7f-b8e3-0403222dd891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:03.725839 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1437/2857] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:47:03 2022] DELETE /identity/v3/projects/97ca95603e184e5d9f250e1b5b06a337 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:47:03.731021 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:03.731869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:03.731869 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:03.751508 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:03.752939 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:03.817986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1421/2858] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:03.826169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:03.826459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:03.826766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:03.846611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:03.847863 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:03.856665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1438/2859] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:03.861576 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:03.872737 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c7c3-faa7-4345-8f52-5e3833a01397 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:03.878282 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:03.879309 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:03.879678 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:03.880088 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:03.880907 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80219) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:47:03.881326 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:03.883799 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:03.897597 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1422/2860] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:47:03.901836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:03.912351 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8528e72-93b9-4a15-b131-10fd26cdb766 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:03.918541 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:03.919219 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:03.919501 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:03.919818 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:03.920523 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:03.922448 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:03.951540 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1439/2861] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:47:03 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:03.956149 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:03.966432 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26325244-f58b-4fa1-8256-a03b2296a4d2 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.013899 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:04.027895 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.028595 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.028883 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.029168 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.029876 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.031892 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.054316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1423/2862] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:47:03 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:04.059067 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.069771 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961e71e-f8c7-4b32-9df8-74a4a5806ab6 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.074783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.075470 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.075795 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.076130 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.076870 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.078539 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.090647 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1440/2863] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:04.094844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.106703 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff614-931b-4d24-b119-aebecc71c509 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.112104 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1130d-096b-4319-a839-a0351952edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.113230 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1130d-096b-4319-a839-a0351952edb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.113517 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1130d-096b-4319-a839-a0351952edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.113802 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1130d-096b-4319-a839-a0351952edb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.114550 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1130d-096b-4319-a839-a0351952edb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.116773 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1130d-096b-4319-a839-a0351952edb2 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.128894 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1424/2864] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 16:47:04.133742 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.144048 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134f0e-e166-4d00-a7b8-df4047f66066 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.148825 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.149721 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.150009 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.150286 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] PATH_INFO: `/v3/projects/f7c0a825ebf44c35a0b77abc76589730/users/ab5046d0d9794f7dabc1150c595e8b79/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.153662 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:04.167222 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c0a825ebf44c35a0b77abc76589730, user_id=ab5046d0d9794f7dabc1150c595e8b79, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.170038 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.184275 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1441/2865] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:47:04 2022] PUT /identity/v3/projects/f7c0a825ebf44c35a0b77abc76589730/users/ab5046d0d9794f7dabc1150c595e8b79/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:04.195832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.196402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.196803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.224615 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] MFA Rules not processed for user `ab5046d0d9794f7dabc1150c595e8b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:04.226248 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:04.292195 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1425/2866] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:04.296714 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.359707 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305cfb-5e7c-43b6-8897-d6d97fce47d5 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.364538 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.365210 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.365500 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.365776 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] PATH_INFO: `/v3/projects` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.366459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.368453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.395069 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1442/2867] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:47:04 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 16:47:04.400003 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.410782 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe29e-34a2-4d8f-b112-8b38064bc8b7 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.467485 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.468191 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.468477 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.468757 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] PATH_INFO: `/v3/users` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.469467 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.471398 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.491669 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1426/2868] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:47:04 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:04.495697 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.507195 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233721-6acd-4516-bd89-99d4bf07992a admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.511888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.512545 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.512829 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.513106 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.513832 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.515436 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.526608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1443/2869] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:04.530759 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.540832 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03c1f-58ff-4bd8-888e-76be0b756c32 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.545438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.546317 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.546605 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.546888 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] PATH_INFO: `/v3/projects/36f4257c6eb2453aa585b1f162729de0/users/7e4eb48021294d1393b625cf7f3b9387/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.561714 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f4257c6eb2453aa585b1f162729de0, user_id=7e4eb48021294d1393b625cf7f3b9387, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.564510 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.578430 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1427/2870] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:47:04 2022] PUT /identity/v3/projects/36f4257c6eb2453aa585b1f162729de0/users/7e4eb48021294d1393b625cf7f3b9387/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:04.582368 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.593094 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd794-ffd4-435e-a93f-12a4b6c3bbe0 admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.658216 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e9e3b-4ff1-41f3-92b1-6db4a36d9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.658888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e9e3b-4ff1-41f3-92b1-6db4a36d9a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.659178 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e9e3b-4ff1-41f3-92b1-6db4a36d9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.659459 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e9e3b-4ff1-41f3-92b1-6db4a36d9a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.660236 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e9e3b-4ff1-41f3-92b1-6db4a36d9a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.661846 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e9e3b-4ff1-41f3-92b1-6db4a36d9a9c admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.671773 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1444/2871] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:04.676029 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.686875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668b07a-ee07-4ed4-be92-1925207bd2bd admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.691427 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.692341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.692618 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.692887 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] PATH_INFO: `/v3/projects/36f4257c6eb2453aa585b1f162729de0/users/7e4eb48021294d1393b625cf7f3b9387/roles/627731b88fe44de39e8e182a119e4c00` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.695375 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f4257c6eb2453aa585b1f162729de0, user_id=7e4eb48021294d1393b625cf7f3b9387, role_id=627731b88fe44de39e8e182a119e4c00)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.698239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.711856 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1428/2872] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:47:04 2022] PUT /identity/v3/projects/36f4257c6eb2453aa585b1f162729de0/users/7e4eb48021294d1393b625cf7f3b9387/roles/627731b88fe44de39e8e182a119e4c00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:04.720995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.721288 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.721571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.747987 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] MFA Rules not processed for user `7e4eb48021294d1393b625cf7f3b9387`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:04.749277 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:04.795390 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:04.825237 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1445/2873] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:04.837318 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:04.839062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:04.849793 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:04.905440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab23f8d-9257-4403-bc76-8cad11b025d7 admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:04.909327 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:04.909978 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:04.910261 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:04.910540 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:04.980694 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:04.982174 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:04.993186 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1429/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:09.266766 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:09.268241 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:09.280625 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1699-e101-4ae3-b69b-d0e8a919477f None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:09.284380 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7d0c1-d487-4425-aee6-482441e6dfec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:09.285023 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d0c1-d487-4425-aee6-482441e6dfec service cinder] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:09.285305 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d0c1-d487-4425-aee6-482441e6dfec service cinder] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:09.285582 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d0c1-d487-4425-aee6-482441e6dfec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:09.297943 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7d0c1-d487-4425-aee6-482441e6dfec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:09.299381 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7d0c1-d487-4425-aee6-482441e6dfec service cinder] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:09.309915 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1446/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:14.363440 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:14.425637 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211415f5-1cd8-4dc1-ba93-f425da103a86 service cinder] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:14.430147 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:14.431015 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:14.431303 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:14.431580 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] PATH_INFO: `/v3/users/ab5046d0d9794f7dabc1150c595e8b79` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:14.432787 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5046d0d9794f7dabc1150c595e8b79)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:14.434725 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:14.481388 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5046d0d9794f7dabc1150c595e8b79'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:14.482046 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5046d0d9794f7dabc1150c595e8b79'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:14.489098 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5046d0d9794f7dabc1150c595e8b79'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:14.497070 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:14.502237 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5046d0d9794f7dabc1150c595e8b79'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:14.510189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5046d0d9794f7dabc1150c595e8b79'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:14.516148 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1430/2876] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:47:14 2022] DELETE /identity/v3/users/ab5046d0d9794f7dabc1150c595e8b79 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:14.520608 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:14.521082 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:14.521183 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:14.540585 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:14.541783 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:14.600687 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1447/2877] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:14.610547 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:14.611977 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:14.670986 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdfa65-6631-448c-8f17-405cb3aac00b admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:14.675314 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:14.676001 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:14.676292 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:14.676570 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:14.686601 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:14.688090 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:14.698341 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1431/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:14.997271 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.000019 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:15.014611 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfc97-b35c-457b-97c0-859ecd82a733 None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:15.020760 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:15.021646 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.021931 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.022290 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] PATH_INFO: `/v3/projects/f7c0a825ebf44c35a0b77abc76589730` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.024026 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c0a825ebf44c35a0b77abc76589730)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:15.025970 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:15.040319 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.041932 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:15.083548 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c0a825ebf44c35a0b77abc76589730', 'request_id': 'req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.090250 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c0a825ebf44c35a0b77abc76589730', 'request_id': 'req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.097888 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c0a825ebf44c35a0b77abc76589730', 'request_id': 'req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.112961 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] The token cache is being invalidate because project f7c0a825ebf44c35a0b77abc76589730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80220) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:47:15.113199 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.113828 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.115482 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1448/2879] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:47:14 2022] DELETE /identity/v3/projects/f7c0a825ebf44c35a0b77abc76589730 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:15.120164 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.121600 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:15.154838 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7b53-3fb9-4c2b-b8ae-83e83f8701f1 service neutron] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:15.184655 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:15.199944 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2cdc9-2ed9-4e70-a903-32a5fbb49f2f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:15.207205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:15.208159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.208447 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.208960 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] PATH_INFO: `/v3/users/7e4eb48021294d1393b625cf7f3b9387` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.210427 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4eb48021294d1393b625cf7f3b9387)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:15.212554 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:15.228387 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0610a73cbaf54e21a63a0469ceb9c856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:15.229062 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.229351 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.229628 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.231700 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:15.245067 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:15.246748 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:15.252461 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:15.261457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1432/2880] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 16:47:15.272836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4eb48021294d1393b625cf7f3b9387'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.274248 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4eb48021294d1393b625cf7f3b9387'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.282622 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4eb48021294d1393b625cf7f3b9387'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.298312 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4eb48021294d1393b625cf7f3b9387'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.299193 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-ddec4f29-8bf8-4f48-a6c0-13e90ead0fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4eb48021294d1393b625cf7f3b9387'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.312571 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1449/2881] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:47:15 2022] DELETE /identity/v3/users/7e4eb48021294d1393b625cf7f3b9387 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 16:47:15.594693 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.608718 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0533-5aa2-4661-8c0f-9173a5b86824 service placement] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:15.673202 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:15.674239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.674654 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.674937 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] PATH_INFO: `/v3/projects/36f4257c6eb2453aa585b1f162729de0` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.676234 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f4257c6eb2453aa585b1f162729de0)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:15.678250 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:15.723631 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f4257c6eb2453aa585b1f162729de0', 'request_id': 'req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.729644 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f4257c6eb2453aa585b1f162729de0', 'request_id': 'req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.735775 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f4257c6eb2453aa585b1f162729de0', 'request_id': 'req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.748944 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] The token cache is being invalidate because project 36f4257c6eb2453aa585b1f162729de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:47:15.749239 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.749875 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-3543a5e0-8a3f-4e94-9d56-ee938deb8c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:15.752049 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1433/2882] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:47:15 2022] DELETE /identity/v3/projects/36f4257c6eb2453aa585b1f162729de0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:15.758198 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.758688 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.758790 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.776205 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:15.777431 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:15.836620 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1450/2883] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:15.844953 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.845243 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.845529 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.864389 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:15.865600 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:15.873813 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1434/2884] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:15.877830 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.888017 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbe83-ad45-439b-abc7-4dec44b29d6d None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:15.894614 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:15.895297 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.895581 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.895896 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.896636 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80220) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 16:47:15.896945 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:15.899127 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:15.911203 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1451/2885] 10.222.0.25 () {58 vars in 1152 bytes} [Thu May 19 16:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 16:47:15.916438 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.925668 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072522bc-12e1-4a10-9115-084e4c22a517 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:15.931249 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:15.931923 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:15.932235 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:15.932509 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:15.933189 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:15.935103 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:15.961723 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1435/2886] 10.222.0.25 () {60 vars in 1152 bytes} [Thu May 19 16:47:15 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:15.966124 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:15.976233 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9601e8-e0a1-41ca-8aa4-fd48787c0d7f admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.028715 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:16.035266 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.036272 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.036682 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.036995 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] PATH_INFO: `/v3/users` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.037891 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.040224 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.059998 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1452/2887] 10.222.0.25 () {60 vars in 1143 bytes} [Thu May 19 16:47:15 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 16:47:16.064089 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:16.074850 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a268c5a-0778-453a-b89c-51217f2c5efa admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.080076 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.080769 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.081057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.081338 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] PATH_INFO: `/v3/roles` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.082108 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.083763 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.094402 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1436/2888] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:16.098522 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:16.109567 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0710-bfd8-43fd-8304-7edc481e77ef admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.114612 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84162d10-9297-4d3a-b1b8-db3a2a791ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.115336 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162d10-9297-4d3a-b1b8-db3a2a791ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.115645 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162d10-9297-4d3a-b1b8-db3a2a791ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.115926 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162d10-9297-4d3a-b1b8-db3a2a791ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.116663 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84162d10-9297-4d3a-b1b8-db3a2a791ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.118813 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84162d10-9297-4d3a-b1b8-db3a2a791ce3 admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.132520 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1453/2889] 10.222.0.25 () {58 vars in 1121 bytes} [Thu May 19 16:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 16:47:16.139803 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:16.154898 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231515be-bd94-42b3-8534-1bfd0475509d admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.159450 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.160365 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.160643 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.160915 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] PATH_INFO: `/v3/projects/56867533e3c04c3fb11afabeafad97e5/users/d2df40d4ae5a4ca2835aace384e93a42/roles/348cd2c2c2fb4a71b414a0af2fda86a6` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.176645 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=56867533e3c04c3fb11afabeafad97e5, user_id=d2df40d4ae5a4ca2835aace384e93a42, role_id=348cd2c2c2fb4a71b414a0af2fda86a6)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.179311 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.192808 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1437/2890] 10.222.0.25 () {60 vars in 1482 bytes} [Thu May 19 16:47:16 2022] PUT /identity/v3/projects/56867533e3c04c3fb11afabeafad97e5/users/d2df40d4ae5a4ca2835aace384e93a42/roles/348cd2c2c2fb4a71b414a0af2fda86a6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:16.205804 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] REQUEST_METHOD: `POST` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.206092 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.206386 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.233836 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.auth.core [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] MFA Rules not processed for user `d2df40d4ae5a4ca2835aace384e93a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80220) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:16.235042 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:16.305005 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1454/2891] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:16.340226 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:16.342464 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:16.381965 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:16.414577 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72fb8e-bbca-4bec-9475-6da8a28f46ed admin admin] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.418224 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ea9e6-6369-4e9b-aacd-00547162f84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e01bb2821eec4234917742be62b441ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.418873 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ea9e6-6369-4e9b-aacd-00547162f84d service cinder] REQUEST_METHOD: `GET` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.419160 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ea9e6-6369-4e9b-aacd-00547162f84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.419442 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ea9e6-6369-4e9b-aacd-00547162f84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.427844 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ea9e6-6369-4e9b-aacd-00547162f84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.429305 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ea9e6-6369-4e9b-aacd-00547162f84d service cinder] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.438057 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1438/2892] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:16.452665 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:16.515765 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b461373-b5ba-4506-964e-150b7a06fd6c None None] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.520306 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.521170 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.521453 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.521727 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] PATH_INFO: `/v3/users/d2df40d4ae5a4ca2835aace384e93a42` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.522958 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2df40d4ae5a4ca2835aace384e93a42)` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.525476 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.571842 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2df40d4ae5a4ca2835aace384e93a42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:16.572509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2df40d4ae5a4ca2835aace384e93a42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:16.580357 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2df40d4ae5a4ca2835aace384e93a42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:16.591598 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:16.594169 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2df40d4ae5a4ca2835aace384e93a42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:16.595055 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.notifications [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2df40d4ae5a4ca2835aace384e93a42'} {{(pid=80220) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:16.609739 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1455/2893] 10.222.0.25 () {58 vars in 1223 bytes} [Thu May 19 16:47:16 2022] DELETE /identity/v3/users/d2df40d4ae5a4ca2835aace384e93a42 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:16.614416 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] REQUEST_METHOD: `POST` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.614920 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.615100 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.632266 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.auth.core [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] MFA Rules not processed for user `e0f89e69e35448a6b9abde79d014f879`. Rule list: `[]` (Enabled: `True`). {{(pid=80219) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 16:47:16.633457 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:16.692961 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1439/2894] 10.222.0.25 () {58 vars in 957 bytes} [Thu May 19 16:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 16:47:16.702713 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Authenticating user token {{(pid=80220) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:16.704187 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.fernet_utils [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80220) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:16.769141 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312853b2-6494-4c9d-a3c9-8abd44f2c5ee admin admin] Validating token access rules against request {{(pid=80220) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:16.773510 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571351d9-1f87-4c71-b24e-e9df9cefe9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae2e3c1b1b04ce7950a81c33308d560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b491dffa24c243239d6f40dbacbe6cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80220) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:16.774159 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571351d9-1f87-4c71-b24e-e9df9cefe9fd service neutron] REQUEST_METHOD: `GET` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:16.774442 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571351d9-1f87-4c71-b24e-e9df9cefe9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:16.774719 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571351d9-1f87-4c71-b24e-e9df9cefe9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80220) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:16.786031 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571351d9-1f87-4c71-b24e-e9df9cefe9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:16.787509 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571351d9-1f87-4c71-b24e-e9df9cefe9fd service neutron] RBAC: Authorization granted {{(pid=80220) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:16.798123 dv-cinder-842433-1-smb devstack@keystone.service[80220]: [pid: 80220|app: 0|req: 1456/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Thu May 19 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 16:47:17.078684 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] Authenticating user token {{(pid=80219) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 16:47:17.080198 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.fernet_utils [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80219) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 16:47:17.093487 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7d4ef-5398-463a-8347-9aa5b817ad34 None None] Validating token access rules against request {{(pid=80219) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 16:47:17.098188 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f89e69e35448a6b9abde79d014f879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '728349d622174859ba2f65ffafdfe844', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80219) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 16:47:17.099228 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 16:47:17.099575 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 16:47:17.100058 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] PATH_INFO: `/v3/projects/56867533e3c04c3fb11afabeafad97e5` {{(pid=80219) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 16:47:17.101952 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56867533e3c04c3fb11afabeafad97e5)` {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 16:47:17.104551 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] RBAC: Authorization granted {{(pid=80219) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 16:47:17.153316 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56867533e3c04c3fb11afabeafad97e5', 'request_id': 'req-03da5ecf-441a-4e49-941f-a3f44d3622fb'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:17.158706 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56867533e3c04c3fb11afabeafad97e5', 'request_id': 'req-03da5ecf-441a-4e49-941f-a3f44d3622fb'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:17.164943 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56867533e3c04c3fb11afabeafad97e5', 'request_id': 'req-03da5ecf-441a-4e49-941f-a3f44d3622fb'} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:17.177150 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] The token cache is being invalidate because project 56867533e3c04c3fb11afabeafad97e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80219) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 16:47:17.177446 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:17.178060 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG keystone.notifications [None req-03da5ecf-441a-4e49-941f-a3f44d3622fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80219) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 16:47:17.179599 dv-cinder-842433-1-smb devstack@keystone.service[80219]: [pid: 80219|app: 0|req: 1440/2896] 10.222.0.25 () {58 vars in 1232 bytes} [Thu May 19 16:47:17 2022] DELETE /identity/v3/projects/56867533e3c04c3fb11afabeafad97e5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 16:47:26.793826 dv-cinder-842433-1-smb devstack@keystone.service[80220]: DEBUG dbcounter [-] [80220] Writing DB stats keystone:DELETE=1,keystone:SELECT=32 {{(pid=80220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:27.174350 dv-cinder-842433-1-smb devstack@keystone.service[80219]: DEBUG dbcounter [-] [80219] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}